Alert button
Picture for Wenting Li

Wenting Li

Alert button

Ultrafast CMOS image sensors and data-enabled super-resolution for multimodal radiographic imaging and tomography

Jan 27, 2023
Xin Yue, Shanny Lin, Wenting Li, Bradley T. Wolfe, Steven Clayton, Mark Makela, C. L. Morris, Simon Spannagel, Erik Ramberg, Juan Estrada, Hao Zhu, Jifeng Liu, Eric R. Fossum, Zhehui Wang

Figure 1 for Ultrafast CMOS image sensors and data-enabled super-resolution for multimodal radiographic imaging and tomography
Figure 2 for Ultrafast CMOS image sensors and data-enabled super-resolution for multimodal radiographic imaging and tomography
Figure 3 for Ultrafast CMOS image sensors and data-enabled super-resolution for multimodal radiographic imaging and tomography
Figure 4 for Ultrafast CMOS image sensors and data-enabled super-resolution for multimodal radiographic imaging and tomography

We summarize recent progress in ultrafast Complementary Metal Oxide Semiconductor (CMOS) image sensor development and the application of neural networks for post-processing of CMOS and charge-coupled device (CCD) image data to achieve sub-pixel resolution (thus $super$-$resolution$). The combination of novel CMOS pixel designs and data-enabled image post-processing provides a promising path towards ultrafast high-resolution multi-modal radiographic imaging and tomography applications.

* 12 pages, 10 figures 
Viaarxiv icon

Word-Graph2vec: An efficient word embedding approach on word co-occurrence graph using random walk sampling

Jan 17, 2023
Wenting Li, Yuanzhe Cai, Jiahong Xue, Zeyu Chen

Figure 1 for Word-Graph2vec: An efficient word embedding approach on word co-occurrence graph using random walk sampling
Figure 2 for Word-Graph2vec: An efficient word embedding approach on word co-occurrence graph using random walk sampling
Figure 3 for Word-Graph2vec: An efficient word embedding approach on word co-occurrence graph using random walk sampling
Figure 4 for Word-Graph2vec: An efficient word embedding approach on word co-occurrence graph using random walk sampling

Word embedding has become ubiquitous and is widely used in various text mining and natural language processing (NLP) tasks, such as information retrieval, semantic analysis, and machine translation, among many others. Unfortunately, it is prohibitively expensive to train the word embedding in a relatively large corpus. We propose a graph-based word embedding algorithm, called Word-Graph2vec, which converts the large corpus into a word co-occurrence graph, then takes the word sequence samples from this graph by randomly traveling and trains the word embedding on this sampling corpus in the end. We posit that because of the stable vocabulary, relative idioms, and fixed expressions in English, the size and density of the word co-occurrence graph change slightly with the increase in the training corpus. So that Word-Graph2vec has stable runtime on the large scale data set, and its performance advantage becomes more and more obvious with the growth of the training corpus. Extensive experiments conducted on real-world datasets show that the proposed algorithm outperforms traditional Skip-Gram by four-five times in terms of efficiency, while the error generated by the random walk sampling is small.

Viaarxiv icon

A Monotonicity Constrained Attention Module for Emotion Classification with Limited EEG Data

Aug 17, 2022
Dongyang Kuang, Craig Michoski, Wenting Li, Rui Guo

Figure 1 for A Monotonicity Constrained Attention Module for Emotion Classification with Limited EEG Data
Figure 2 for A Monotonicity Constrained Attention Module for Emotion Classification with Limited EEG Data
Figure 3 for A Monotonicity Constrained Attention Module for Emotion Classification with Limited EEG Data
Figure 4 for A Monotonicity Constrained Attention Module for Emotion Classification with Limited EEG Data

In this work, a parameter-efficient attention module is presented for emotion classification using a limited, or relatively small, number of electroencephalogram (EEG) signals. This module is called the Monotonicity Constrained Attention Module (MCAM) due to its capability of incorporating priors on the monotonicity when converting features' Gram matrices into attention matrices for better feature refinement. Our experiments have shown that MCAM's effectiveness is comparable to state-of-the-art attention modules in boosting the backbone network's performance in prediction while requiring less parameters. Several accompanying sensitivity analyses on trained models' prediction concerning different attacks are also performed. These attacks include various frequency domain filtering levels and gradually morphing between samples associated with multiple labels. Our results can help better understand different modules' behaviour in prediction and can provide guidance in applications where data is limited and are with noises.

* A Preprint for the accepted work by MICCAI 2022 workshop: Medical Image Learning with Noisy and Limited Data 
Viaarxiv icon

High-resolution chirplet transform: from parameters analysis to parameters combination

Aug 02, 2021
Xiangxiang Zhu, Bei Li, Zhuosheng Zhang, Wenting Li, Jinghuai Gao

Figure 1 for High-resolution chirplet transform: from parameters analysis to parameters combination
Figure 2 for High-resolution chirplet transform: from parameters analysis to parameters combination
Figure 3 for High-resolution chirplet transform: from parameters analysis to parameters combination
Figure 4 for High-resolution chirplet transform: from parameters analysis to parameters combination

The standard chirplet transform (CT) with a chirp-modulated Gaussian window provides a valuable tool for analyzing linear chirp signals. The parameters present in the window determine the performance of CT and play a very important role in high-resolution time-frequency (TF) analysis. In this paper, we first give the window shape analysis of CT and compare it with the extension that employs a rotating Gaussian window by fractional Fourier transform. The given parameters analysis provides certain theoretical guidance for developing high-resolution CT. We then propose a multi-resolution chirplet transform (MrCT) by combining multiple CTs with different parameter combinations. These are combined geometrically to obtain an improved TF resolution by overcoming the limitations of any single representation of the CT. By deriving the combined instantaneous frequency equation, we further develop a high-concentration TF post-processing approach to improve the readability of the MrCT. Numerical experiments on simulated and real signals verify its effectiveness.

Viaarxiv icon

Physics-Informed Graph Learning for Robust Fault Location in Distribution Systems

Jul 05, 2021
Wenting Li, Deepjyoti Deka

Figure 1 for Physics-Informed Graph Learning for Robust Fault Location in Distribution Systems
Figure 2 for Physics-Informed Graph Learning for Robust Fault Location in Distribution Systems
Figure 3 for Physics-Informed Graph Learning for Robust Fault Location in Distribution Systems
Figure 4 for Physics-Informed Graph Learning for Robust Fault Location in Distribution Systems

The rapid growth of distributed energy resources potentially increases power grid instability. One promising strategy is to employ data in power grids to efficiently respond to abnormal events (e.g., faults) by detection and location. Unfortunately, most existing works lack physical interpretation and are vulnerable to the practical challenges: sparse observation, insufficient labeled datasets, and stochastic environment. We propose a physics-informed graph learning framework of two stages to handle these challenges when locating faults. Stage- I focuses on informing a graph neural network (GNN) with the geometrical structure of power grids; stage-II employs the physical similarity of labeled and unlabeled data samples to improve the location accuracy. We provide a random walk-based the underpinning of designing our GNNs to address the challenge of sparse observation and augment the correct prediction probability. We compare our approach with three baselines in the IEEE 123-node benchmark system, showing that the proposed method outperforms the others by significant margins, especially when label rates are low. Also, we validate the robustness of our algorithms to out-of-distribution-data (ODD) due to topology changes and load variations. Additionally, we adapt our graph learning framework to the IEEE 37-node test feeder and show high location performance with the proposed training strategy.

* 10 pages, 8 figures, journal 
Viaarxiv icon

Machine Learning for Variance Reduction in Online Experiments

Jun 16, 2021
Yongyi Guo, Dominic Coey, Mikael Konutgan, Wenting Li, Chris Schoener, Matt Goldman

Figure 1 for Machine Learning for Variance Reduction in Online Experiments

We consider the problem of variance reduction in randomized controlled trials, through the use of covariates correlated with the outcome but independent of the treatment. We propose a machine learning regression-adjusted treatment effect estimator, which we call MLRATE. MLRATE uses machine learning predictors of the outcome to reduce estimator variance. It employs cross-fitting to avoid overfitting biases, and we prove consistency and asymptotic normality under general conditions. MLRATE is robust to poor predictions from the machine learning step: if the predictions are uncorrelated with the outcomes, the estimator performs asymptotically no worse than the standard difference-in-means estimator, while if predictions are highly correlated with outcomes, the efficiency gains are large. In A/A tests, for a set of 48 outcome metrics commonly monitored in Facebook experiments the estimator has over 70% lower variance than the simple difference-in-means estimator, and about 19% lower variance than the common univariate procedure which adjusts only for pre-experiment values of the outcome.

Viaarxiv icon

Real-time Fault Localization in Power Grids With Convolutional Neural Networks

Oct 11, 2018
Wenting Li, Deepjyoti Deka, Michael Chertkov, Meng Wang

Figure 1 for Real-time Fault Localization in Power Grids With Convolutional Neural Networks
Figure 2 for Real-time Fault Localization in Power Grids With Convolutional Neural Networks
Figure 3 for Real-time Fault Localization in Power Grids With Convolutional Neural Networks
Figure 4 for Real-time Fault Localization in Power Grids With Convolutional Neural Networks

Diverse fault types, fast re-closures and complicated transient states after a fault event make real-time fault location in power grids challenging. Existing localization techniques in this area rely on simplistic assumptions, such as static loads, or require much higher sampling rates or total measurement availability. This paper proposes a data-driven localization method based on a Convolutional Neural Network (CNN) classifier using bus voltages. Unlike prior data-driven methods, the proposed classifier is based on features with physical interpretations that are described in details. The accuracy of our CNN based localization tool is demonstrably superior to other machine learning classifiers in the literature. To further improve the location performance, a novel phasor measurement units (PMU) placement strategy is proposed and validated against other methods. A significant aspect of our methodology is that under very low observability (7% of buses), the algorithm is still able to localize the faulted line to a small neighborhood with high probability. The performance of our scheme is validated through simulations of faults of various types in the IEEE 68-bus power system under varying load conditions, system observability and measurement quality.

* 8 pages, 8 figures 
Viaarxiv icon