Scaling-up Perceptual Video Quality Assessment

The data scaling law has been shown to significantly enhance the performance of large multi-modal models (LMMs) across various downstream tasks. However, in the domain of perceptual video quality assessment (VQA), the potential of scaling law remains unprecedented due to the scarcity of labeled resources and the insufficient scale of datasets. To address this, we propose \textbf{OmniVQA}, an efficient framework designed to efficiently build high-quality, human-in-the-loop VQA multi-modal instruction databases (MIDBs). We then scale up to create \textbf{OmniVQA-Chat-400K}, the largest MIDB in the VQA field concurrently. Our focus is on the technical and aesthetic quality dimensions, with abundant in-context instruction data to provide fine-grained VQA knowledge. Additionally, we have built the \textbf{OmniVQA-MOS-20K} dataset to enhance the model's quantitative quality rating capabilities. We then introduce a \textbf{complementary} training strategy that effectively leverages the knowledge from datasets for quality understanding and quality rating tasks. Furthermore, we propose the \textbf{OmniVQA-FG (fine-grain)-Benchmark} to evaluate the fine-grained performance of the models. Our results demonstrate that our models achieve state-of-the-art performance in both quality understanding and rating tasks.

Automatic mobility analysis of parallel mechanisms: an algorithm approach based on position and orientation characteristic equations

The determination of the mobility of parallel mechanisms (PM) is a fundamental problem. An automatic and intelligent analysis platform will be a significant tool for the design and optimization of mechanical systems. Based on the theory of position and orientation characteristics (POC) equations, a systematic approach to computer-aided mobility analysis of PMs is presented in this paper. First, a digital model for topological structures which has a mapping relationship with position and orientation characteristics of mechanism is proposed. It describes not only the dimension of the motion output, but also gives the mapping relationship between the output characteristic and the axis of the kinematic joints. Secondly, algorithmic rules are established that convert the union and intersection operations of POC into the binary logical operations and the automatic analysis of POC are realized. Then, the algorithm of the automatic mobility analysis of PMs and its implementation with VC++ are written .The mobility and its properties (POC) will also be analyzed and displayed automatically after introducing by users of the data of topological structures representation. Finally, typical examples are provided to show the effectiveness of the software platform.