research
∙
09/14/2023
A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time
Large language models (LLMs) have played a pivotal role in revolutionizi...
share
research
∙
08/28/2023
Solving Attention Kernel Regression Problem via Pre-conditioner
Large language models have shown impressive performance in many tasks. O...
research
∙
08/21/2023
GradientCoin: A Peer-to-Peer Decentralized Large Language Models
Since 2008, after the proposal of a Bitcoin electronic cash system, Bitc...
research
∙
06/07/2023
Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation
Weighted low rank approximation is a fundamental problem in numerical li...
research
∙
06/06/2023
Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis
Many machine learning algorithms require large numbers of labeled data t...
research
∙
06/01/2023
Faster Robust Tensor Power Method for Arbitrary Order
Tensor decomposition is a fundamental method used in various areas to de...
research
∙
05/27/2023
Federated Empirical Risk Minimization via Second-Order Method
Many convex optimization problems with important applications in machine...
research
∙
05/01/2023
An Iterative Algorithm for Rescaled Hyperbolic Functions Regression
Large language models (LLMs) have numerous real-life applications across...
research
∙
02/21/2023
Low Rank Matrix Completion via Robust Alternating Minimization in Nearly Linear Time
Given a matrix M∈ℝ^m× n, the low rank matrix completion problem asks us ...
research
∙
02/01/2023