Efficient customer segmentation in digital marketing using deep learning with swarm intelligence approach

Nowadays, Artificial Intelligence (AI) based modeling is the major consideration to build efficient, automated, and smart systems for our today's needs. Many companies are benefited from these modeling methods for their marketing efforts. Each firm has expected to increase its product development in an innovative way to improve its business growth. Successful firm marketing is to offer the right product to the right person at the right time. To market the product to the customer successfully, it is needed to segment the customer by finding their behavioral patterns. The customer behaviors and their purchasing patterns are used to generate profit for the company. Customer segmentation is the process of grouping customers based on commonalities. Developing an efficient AI-based customer segmentation to improve digital marketing growth is a challenging task. In this paper, an unsupervised deep learning model called a Self-organizing map with an Improved social spider optimization approach has been used for efficient customer segmentation. The customer data are analyzed by a feature engineering process using a swarm intelligence model called Modified social spider optimization to select the behavioral features of the customer. Then, the customers are clustered using Self Organizing neural network (SONN). Based on the clusters, the customers are classified using the Deep neural network (DNN) model. The experimental results prove the performance of the proposed model with high clustering and segmentation capability to improve the business profit in marketing.     

基于大规模数据分析的融合面部特征的信用风险预测模型

【目的/意义】个人违约信用风险是网络借贷平台所面临的主要风险之一,引起了金融机构的广泛重视。传 统的P2P网络借贷违约风险预测模型通常使用历史数据建模,而模型的对象主要为历史履约和违约因素,由此带来 的因素选择偏差问题会影响模型的泛化能力和风险预测能力。【方法/过程】本文引入面部特征大数据分析方法,利 用深度学习技术自动抽取人脸面部特征变量,将其作为一个新的维度融入以历史借贷数据为核心的信用风险评价 系统,建构新型信用风险预测模型。【结果/结论】论文基于南京某互联网金融公司提供的数据集进行实验与实证分 析,结果表明本文提出的模型优于传统的违约风险预测模型。【创新/局限】本研究的创新点为一方面基于大数据分 析方法挖掘了真实借款人面部特征在预测互联网信贷背景下的贷款违约中的作用,为互联网信贷的信用风险预测 模型提供了新的数据维度,另一方面为使用深度学习方法自动识别和提取大规模图片数据集中的面部特征提供了 新的思路。     

我国P2P网络借贷公共信息平台构架与运营模式研究

网络金融创新迅猛发展,P2P(Peer to Peer Lending)网络借贷行业面临巨大的机会与挑战。通过分析我国网络借贷核心价值网络结构,并基于放贷人制度与信息协同共享机制,构建放贷人、借款人、运营商、金融机构四方(4C,Four Parties Cooperation Winner)协同共赢的公共信息平台构架体系,总结凝练出具有中国本土化特色的P2P网络借贷4C协同共赢运营模式,为促进我国P2P网络借贷产业健康发展提出对策建议。     

Adversarial data hiding with only one pixel

Making adversarial samples to fool deep neural network (DNN) is an emerging research direction of privacy protection, since the output of the attacker's DNN can be easily changed by the well-designed tiny perturbation added to the input vector. However, the added perturbation is meaningless. Why not embed some useful information to generate adversarial samples while integrating the functions of copyright and integrity protection of data hiding? This paper solves the problem by modifying only one pixel of the image, that is, data hiding and adversarial sample generation are achieved simultaneously by the only one modified pixel. In CIFAR-10 dataset, 11 additional bits can be embedded into the host images sized 32 × 32, and the successful rate of adversarial attack is close to the state-of-the-art works. This paper proposes a new idea to combine data hiding and adversarial sample generation, and gives a new method for privacy-preserved processing of image big data.     

Learning soft mask with DNN and DNN-SVM for multi-speaker DOA estimation using an acoustic vector sensor

Using an acoustic vector sensor (AVS), an efficient method has been presented recently for direction of arrival (DOA) estimation of multiple speech sources via the clustering of the inter-sensor data ratio (AVS-ISDR). Through extensive experiments on simulated and recorded data, we observed that the performance of the AVS-DOA method is largely dependent on the reliable extraction of the target speech dominated time–frequency points (TD-TFPs) which, however, may be degraded with the increase in the level of additive noise and room reverberation in the background. In this paper, inspired by the great success of deep learning in speech recognition, we design two new soft mask learners, namely deep neural network (DNN) and DNN cascaded with a support vector machine (DNN-SVM), for multi-source DOA estimation, where a novel feature, namely, the tandem local spectrogram block (TLSB) is used as the input to the system. Using our proposed soft mask learners, the TD-TFPs can be accurately extracted under different noisy and reverberant conditions. Additionally, the generated soft masks can be used to calculate the weighted centers of the ISDR-clusters for better DOA estimation as compared to the original center used in our previously proposed AVS-ISDR. Extensive experiments on simulated and recorded data have been presented to show the improved performance of our proposed methods over two baseline AVS-DOA methods in presence of noise and reverberation.     

钢板表面缺陷深度主动学习高效分类方法

针对钢板表面缺陷图像分类传统深度学习算法中需要大量标签数据的问题,提出一种基于主动学习的高效分类方法。该方法包含一个轻量级的卷积神经网络和一个基于不确定性的主动学习样本筛选策略。神经网络采用简化的convolutional base进行特征提取,然后用全局池化层替换掉传统密集连接分类器中的隐藏层来减轻过拟合。为了更好的衡量模型对未标签图像样本所属类别的不确定性,首先将未标签图像样本传入到用标签图像样本训练好的模型,得到模型对每一个未标签样本关于标签的概率分布(probability distribution over classes, PDC),然后用此模型对标签样本进行预测并得到模型对每个标签的平均PDC。将两类分布的KL-divergence值作为不确定性指标来筛选未标签图像进行人工标注。根据在NEU-CLS开源缺陷数据集上的对比实验,该方法可以通过44%的标签数据实现97%的准确率,极大降低标注成本。     

Citizens as consumers: Profiling e-government services’ users in Egypt via data mining techniques

This study uses data mining techniques to examine the effect of various demographic, cognitive and psychographic factors on Egyptian citizens’ use of e-government services. Data mining uses a broad family of computationally intensive methods that include decision trees, neural networks, rule induction, machine learning and graphic visualization. Three artificial neural network models (multi-layer perceptron neural network [MLP], probabilistic neural network [PNN] and self-organizing maps neural network [SOM]) and three machine learning techniques (classification and regression trees [CART], multivariate adaptive regression splines [MARS], and support vector machines [SVM]) are compared to a standard statistical method (linear discriminant analysis [LDA]). The variable sets considered are sex, age, educational level, e-government services perceived usefulness, ease of use, compatibility, subjective norms, trust, civic mindedness, and attitudes. The study shows how it is possible to identify various dimensions of e-government services usage behavior by uncovering complex patterns in the dataset, and also shows the classification abilities of data mining techniques.     

Listening to the investors: A novel framework for online lending default prediction using deep learning neural networks

Online peer-to-peer (P2P) lending has developed dramatically over the last decade in China. But this rapid boom carries potential risks. Investors have incurred incalculable losses due to the recent increase in fraudulent and/or unreliable online P2P platforms. Hence, predicting and identifying potential default risk platforms is crucial at this juncture. To achieve this end, we propose a two-step method which employs a deep learning neural network to extract keywords from investor comments and then utilizes a bidirectional long short-term memory (BiLSTM) based model to predict the default risk of platforms. Experimental results on real-world datasets of about 1000 platforms show that in the keyword extraction phase, our model can better capture semantic features from highly colloquial comment-text and achieve significant improvement over other baselines. Additionally, in the default platform prediction stage, our model achieves an F1 value of 80.34% in identifying potential problem platforms, outperforming four baselines by 23.37%, 5.71%, 8.93%, and 4.98% of improvement and comprehensively verifying the effectiveness of our method. Our study provides an alternative solution for platform default risk prediction issues and validates the effectiveness of investor comments in revealing the risk situation of online lending platforms.     

Bayesian network based extreme learning machine for subjectivity detection

Subjectivity detection is a task of natural language processing that aims to remove ‘factual’ or ‘neutral’ content, i.e., objective text that does not contain any opinion, from online product reviews. Such a pre-processing step is crucial to increase the accuracy of sentiment analysis systems, as these are usually optimized for the binary classification task of distinguishing between positive and negative content. In this paper, we extend the extreme learning machine (ELM) paradigm to a novel framework that exploits the features of both Bayesian networks and fuzzy recurrent neural networks to perform subjectivity detection. In particular, Bayesian networks are used to build a network of connections among the hidden neurons of the conventional ELM configuration in order to capture dependencies in high-dimensional data. Next, a fuzzy recurrent neural network inherits the overall structure generated by the Bayesian networks to model temporal features in the predictor. Experimental results confirmed the ability of the proposed framework to deal with standard subjectivity detection problems and also proved its capacity to address portability across languages in translation tasks.     

Exploring temporal representations by leveraging attention-based bidirectional LSTM-RNNs for multi-modal emotion recognition

Emotional recognition contributes to automatically perceive the user’s emotional response to multimedia content through implicit annotation, which further benefits establishing effective user-centric services. Physiological-based ways have increasingly attract researcher’s attention because of their objectiveness on emotion representation. Conventional approaches to solve emotion recognition have mostly focused on the extraction of different kinds of hand-crafted features. However, hand-crafted feature always requires domain knowledge for the specific task, and designing the proper features may be more time consuming. Therefore, exploring the most effective physiological-based temporal feature representation for emotion recognition becomes the core problem of most works. In this paper, we proposed a multimodal attention-based BLSTM network framework for efficient emotion recognition. Firstly, raw physiological signals from each channel are transformed to spectrogram image for capturing their time and frequency information. Secondly, Attention-based Bidirectional Long Short-Term Memory Recurrent Neural Networks (LSTM-RNNs) are utilized to automatically learn the best temporal features. The learned deep features are then fed into a deep neural network (DNN) to predict the probability of emotional output for each channel. Finally, decision level fusion strategy is utilized to predict the final emotion. The experimental results on AMIGOS dataset show that our method outperforms other state of art methods.     

基于最小二乘支持向量机的数据挖掘应用研究

随着数据仓库技术、联机分析技术的发展。基于数据库的数据挖掘已成为一种重要的数据处理手段。最小二乘支持向量机作为一种新的机器学习方法。具有全局收敛性和良好的泛化能力。本文将其应用于数据挖掘的分类与预测研究。通过棱函数的选择及参数优化，并结合支持向量机、多层感知器神经网络模型及判别分析方法进行比较研究，证明最小二乘支持向量机作为一种有效的数据挖掘算法具有较高精度。     

基于BERT-BiLSTM模型的舆情监测方法及实证研究——以研究生招生考试为例

【目的/意义】教育招生考试备受社会各界关注,极易触发舆情事件。及时监测并准确研判相关网络信息传 播发展态势,发现潜在舆情并处置应对,对于保障考试安全和维护学校声誉具有重要意义。【方法/过程】采集研究 生复试期间主流媒体社交平台数据,将BERT语言训练模型同BiLSTM相结合,构建深度神经网络模型,对文本的 情感极性进行分析。用TextRank算法提取不同情感极性类属文本的热门主题词,监测潜在舆情并提出管理建议。 【结果/结论】实证结果表明,该模型能够有效挖掘不同情感极性下的热门主题信息,从而发现潜在隐患以及可能发 生的舆情焦点,为高校网络舆情管控提供了方法参考和实践依据。【创新/局限】与传统方法相比,基于BERT的预训 练语言模型可有效解决因数据量少而导致模型无法准确表示不同语句之间复杂关系的局限性,同时BERT可对文 本进行双向建模,捕获不同句子之间的关系特点,提升对文本情感主题挖掘的准确性。     

gDART: Improving rumor verification in social media with Discrete Attention Representations

Due to the harmful impact of fabricated information on social media, many rumor verification techniques have been introduced in recent years. Advanced techniques like multi-task learning (MTL), shared-private models suffer from many strategic limitations that restrict their capability of veracity identification on social media. These models are often reliant on multiple tasks for the primary targeted objective. Even the most recent deep neural network (DNN) models like VRoC, Hierarchical-PSV, StA-HiTPLAN etc. based on VAE, GCN, Transformer respectively with improved modification are able to perform good on veracity identification task but with the help of additional auxiliary information, mostly. However, their rise is still not substantial with respect to the proposed model even though the proposed model is not using any additional information. To come up with an improved DNN model architecture, we introduce globally Discrete Attention Representations from Transformers (gDART). Discrete-Attention mechanism in gDART is capable of capturing multifarious correlations veiled among the sequence of words which existing DNN models including Transformer often overlook. Our proposed framework uses a Branch-CoRR Attention Network to extract highly informative features in branches, and employs Feature Fusion Network Component to identify deep embedded features and use them to make enhanced identification of veracity of an unverified claim. Moreover, to achieve its goal, gDART is not dependent on any costly auxiliary resource but on an unsupervised learning process. Extensive experiments reveal that gDART marks a considerable performance gain in veracity identification task over state-of-the-art models on two real world rumor datasets. gDART reports a gain of 36.76%, 40.85% on standard benchmark metrics.     

Towards a real-time processing framework based on improved distributed recurrent neural network variants with fastText for social big data analytics

Big data generated by social media stands for a valuable source of information, which offers an excellent opportunity to mine valuable insights. Particularly, User-generated contents such as reviews, recommendations, and users’ behavior data are useful for supporting several marketing activities of many companies. Knowing what users are saying about the products they bought or the services they used through reviews in social media represents a key factor for making decisions. Sentiment analysis is one of the fundamental tasks in Natural Language Processing. Although deep learning for sentiment analysis has achieved great success and allowed several firms to analyze and extract relevant information from their textual data, but as the volume of data grows, a model that runs in a traditional environment cannot be effective, which implies the importance of efficient distributed deep learning models for social Big Data analytics. Besides, it is known that social media analysis is a complex process, which involves a set of complex tasks. Therefore, it is important to address the challenges and issues of social big data analytics and enhance the performance of deep learning techniques in terms of classification accuracy to obtain better decisions.In this paper, we propose an approach for sentiment analysis, which is devoted to adopting fastText with Recurrent neural network variants to represent textual data efficiently. Then, it employs the new representations to perform the classification task. Its main objective is to enhance the performance of well-known Recurrent Neural Network (RNN) variants in terms of classification accuracy and handle large scale data. In addition, we propose a distributed intelligent system for real-time social big data analytics. It is designed to ingest, store, process, index, and visualize the huge amount of information in real-time. The proposed system adopts distributed machine learning with our proposed method for enhancing decision-making processes. Extensive experiments conducted on two benchmark data sets demonstrate that our proposal for sentiment analysis outperforms well-known distributed recurrent neural network variants (i.e., Long Short-Term Memory (LSTM), Bidirectional Long Short-Term Memory (BiLSTM), and Gated Recurrent Unit (GRU)). Specifically, we tested the efficiency of our approach using the three different deep learning models. The results show that our proposed approach is able to enhance the performance of the three models. The current work can provide several benefits for researchers and practitioners who want to collect, handle, analyze and visualize several sources of information in real-time. Also, it can contribute to a better understanding of public opinion and user behaviors using our proposed system with the improved variants of the most powerful distributed deep learning and machine learning algorithms. Furthermore, it is able to increase the classification accuracy of several existing works based on RNN models for sentiment analysis.     

Modeling switched circuits based on wavelet decomposition and neural networks

In this paper, switched circuits are modeled based on wavelet decomposition and neural network. Also describes the usage of wavelet decomposition and neural network for modeling and simulation of nonlinear systems. The switched circuits are piecewise-linear circuits. At each position of switch the circuit is linear but when considered all switching positions of the circuit it becomes nonlinear. An important problem which arises in modeling switched circuit is high structural complexity. In this study, wavelet decomposition is used for feature extracting from input signals and neural network is used as an intelligent modeling tool. Two performance measures root-mean-square (RMS) and the coefficient of multiple determinations (R²) are given to compare the predicted and computed values for model validation. The evaluated R² value is 0.9985 and RMS value is 0.0099. All simulations showed that the proposed method is more effective and can be used for analyzing and modeling switched circuits. When we consider obtained performance, we can easily say that the proposed method can be used efficiently for modeling any other nonlinear dynamical systems.     

P2P借款的损失能挽回吗?——基于拍拍贷的实证研究

为解决网贷行业"去担保化"所带来的出借者损失问题,本文将P2P网络借贷的研究视角扩展到违约后还款阶段,探究了违约者还款的影响因素。重点讨论借贷可得性因素及违约者类型对于违约追偿处理的影响路径及机制,进而以纯中介平台拍拍贷2007年至2014年的违约黑名单为样本,基于时序性数据和Logit模型就借贷可得性因素和违约者类型对借款者违约后还款的影响及作用机制进行了实证检验,结果表明:(1)整体上看,人口属性与借贷数据都显著影响还款,其中男性、收入来源和借款金额正向显著影响,借贷可得性因素部分对违约后还款的影响被部分证明;(2)在追偿阶段财务类指标判别效果优于信用认证,说明面临财务困境的违约者更易还款;(3)违约者类型对追偿路径具有重要影响,违约者可根据是否具有还款意愿被分为"策略型"和"财务型"两类,财务能力是影响财务型违约者还款的关键因素,而信息认证产生的交流渠道则是对策略型违约者追偿的主要途径。     

基于径向基函数的非线性混合信号的盲分离

通过径向基函数(RBF)神经网络近似非线性混合映射的方法,研究了一种从非线性混合信号中盲源分离的算法。该方法采用RBF神经网络分离系统输出分量的互信息作为目标函数,目标函数的最小化导致输出量之间的独立性,以便使源信号尽可能的分离出来。采用无监督的模糊C均值聚类方法训练RBF神经网络的权值,可以大大节省计算量。仿真结果讨论了RBF神经网络隐含层不同的神经元个数对盲源分离效果的影响,并且证明了本算法是有效性的和可行的,并且有较强的鲁棒性。     

中国经济发展水平区域差异的人工神经网络判定

本文在对目前经济发展水平度量方法进行分析的基础上,运用人工神经网络(ANN)的理论和方法,构建了ANN模型分析中应用最为广泛的BP网络,并对2000年中国31个省、市(自治区)的经济发展水平进行了评价.网络运行结果表明,中国经济发展水平的区域差异显著,评价结果与专家的判断基本近似.根据评价结果,采用最短聚类分析法,将中国区域经济发展水平分为5级,经济发展水平较高的省(市、区)主要分布在东部沿海地区,经济发展水平较低及落后的省(市、区)主要分布在中部和西部地区,中国经济发展水平的区域差异主要表现为东部和中西部及沿海和内地的差异.可见,人工神经网络用于评价经济发展水平简便、实用,且避免了人工确定指标权重的主观性,是一条具有发展和应用前景的途径.     

基于SOM神经网络的负荷特性分类

负荷模型对电力系统仿真结果有重要影响,由于负荷特性的辨识是负荷建模的主要方面之一,故提高负荷模型的准确度就需要对负荷特性分类进行研究。文章在详细分析SOM自组织映射神经网络结构的基础上,采用了基于SOM神经网络的负荷分类方法,以负荷模型参数作为负荷动态特性分类特征向量,应用SOM神经网络对负荷特性进行分类,并对分类结果进行测试,结果表明该方法可有效地对负荷样本进行分类。