Inference and serving
91 people are listed under this topic in the USASI directory. Most common companies: llama.cpp project (12), Hugging Face (7), NVIDIA (5), IBM (4), vLLM project (4).
Top companies in Inference and serving
- llama.cpp project 12
- Hugging Face 7
- NVIDIA 5
- IBM 4
- vLLM project 4
- Anthropic 3
- Baseten 3
- Inferact 3
- LMSYS 3
- Meta 3
- Red Hat 3
- Carnegie Mellon University 2
People
- 0xSeroDeveloper; the Omacom Foundation's announcement names Sybil Solutions as 0xSero's company · Sybil Solutions
- Aaron TeoTechnology Engineer, IBM Client Engineering · IBM
- Adrien GallouëtHugging Face is the company listed on Gallouët's GitHub profile · Hugging Face
- Akshat BubnaCo-founder and CTO · Modal
- Aldehir RojasMember of the llama-common code-owner team · llama.cpp project
- Amir HaghighatCo-founder and Chief Technology Officer · Baseten
- Andrew FeldmanChief Executive Officer and Co-Founder · Cerebras Systems
- Arjun DesaiCo-founder · Cartesia
- Awni HannunMember of the Technical Staff · Anthropic
- Azalia MirhoseiniAssistant Professor of Computer Science; directs the Scaling Intelligence lab · Stanford University
- BartowskiSenior Machine Learning Engineer · Red Hat
- Bill DallyChief scientist and senior vice president of NVIDIA Research · NVIDIA
- Byron HsuMerge oncall for prefill-decode (PD) disaggregation · SGLang project
- Carlos CostaDistinguished Engineer · IBM
- Chris LattnerCo-founder · Modular
- Dane KnechtChief Technology Officer · Cloudflare
- Daniel BeveniusHugging Face is the company listed on Bevenius's GitHub profile · Hugging Face
- Daniel HanListed on Unsloth's About page for software, data, and algorithms · Unsloth
- Davide EynardOpen-source and trustworthy AI work (blog author) · Mozilla.ai
- Dmytro DzhulgakovCo-Founder · Fireworks AI
- Dylan PatelAuthor of the SemiAnalysis newsletter · SemiAnalysis
- Eric HartfordFounder · Quixi.AI
- Erik BernhardssonFounder and CEO · Modal
- Erik GafniFounder and CTO · TypeSafe AI
- Furu WeiDistinguished Scientist and Vice President; Chief Scientist of Microsoft Research Asia, leading the GenAI group · Microsoft Research
- Gavin UbertiCo-founder and CEO · Etched
- Georgi GerganovMaintains llama.cpp with the ggml team · Hugging Face
- Hani JamjoomBuilders & open source
- Hao ZhangAssistant Professor, Halıcıoğlu Data Science Institute and Computer Science and Engineering; leads the Hao AI Lab · University of California San Diego
- Horace HeCore Maintainer · PyTorch (open-source project)
- Ian BuckVice President of Hyperscale and High-Performance Computing · NVIDIA
- Ion StoicaProfessor of Computer Science, Xu Bao Chancellor Chair; Director of the Sky Computing Lab · University of California, Berkeley
- Jeff BolzDistinguished Engineer · NVIDIA
- Jeff JohnsonResearch Scientist, SysML group, Fundamental AI Research (FAIR) · Meta
- Jeffrey MorganBuilding Ollama · Ollama
- Johannes GäßlerExperimental particle physicist · Karlsruhe Institute of Technology
- Jonathan RossBuilders & open source
- Joseph E. GonzalezAssociate Professor, Department of Electrical Engineering and Computer Sciences · University of California, Berkeley
- Joshua LochnerWorking on Transformers.js · Hugging Face
- Julien SimonAI Operating Partner · Fortino Capital
- Kaichao YouCo-founder and Chief Scientist · Inferact
- Krithik PuthalathFounder and CEO · Zyphra
- Kunle OlukotunCo-founder and Chief Technologist · SambaNova
- Lin QiaoCo-founder and CEO · Fireworks AI
- Luis Héctor ChávezChief Technology Officer · Replit
- Mark SaroufimCofounder · Core Automation
- Matt HicksPresident and Chief Executive Officer · Red Hat
- Matthew PrinceCo-founder and CEO · Cloudflare
- Matthew ZeilerBuilders & open source
- Matthijs DouzeResearch Scientist, Fundamental AI Research (FAIR), since November 2015 · Meta
- Max KrasnyanskyMember of the Hexagon and OpenCL backend code-owner teams · llama.cpp project
- MiaDeveloper · Mia's AI Lab
- Michael IntratorCo-founder, Chairman and Chief Executive Officer (leading the company since 2017) · CoreWeave
- Mitesh AgrawalBuilders & open source
- Neo ZhangCode owner for the SYCL backend (ggml-org/ggml-sycl) · llama.cpp project
- Oleksiy OstapenkoBuilders & open source
- Olivier ChafikAnthropic is the company listed on Chafik's GitHub profile · Anthropic
- Pankaj GuptaCo-founder · Baseten
- Patrick von PlatenBuilders & open source
- Pedro CuencaMachine learning engineer · Hugging Face
- Peiyuan ZhangWorks at ByteDance (title not stated) · ByteDance
- Pete WardenCEO · Useful Sensors Inc
- Peter SalankiCo-founder and Chief Technology Officer (CTO since March 2024) · CoreWeave
- Philipp SchmidStaff Engineer (Developer Experience and Developer Relations) · Google DeepMind
- Pierrick HymbertDeveloper (BNP Paribas is the company listed on Hymbert's GitHub profile) · BNP Paribas
- Piotr WilkinSystems architect · Syndatis
- Priya NagpurkarVice President of AI Platform (as titled by IBM Research in March 2026) · IBM Research
- Radoslav GerganovCode owner for the RPC backend (ggml-org/ggml-rpc) · llama.cpp project
- Rahul PatilChief Technology Officer · Anthropic
- Rajat SenResearch Scientist · Google Research
- Robert ShawDirector of Engineering · Red Hat
- Robert WachenCo-founder and President · Etched
- Rodrigo LiangCo-founder and CEO · SambaNova
- Sid ShethFounder and CEO · d-Matrix
- Sigbjørn SkjæretHugging Face is the company listed on Skjæret's GitHub profile · Hugging Face
- Simon MoCo-founder · Inferact
- Song HanAssociate Professor with tenure, EECS · Massachusetts Institute of Technology
- Sudeep BhojaCo-founder and CTO · d-Matrix
- TheBlokeBuilders & open source
- Tianqi ChenAssociate Professor, Machine Learning Department and Computer Science Department · Carnegie Mellon University
- Tim DavisSenior Vice President and General Manager of Modular · Qualcomm
- Tim DettmersAssistant Professor · Carnegie Mellon University
- Tuhin SrivastavaCEO and Co-founder · Baseten
- Vipul Ved PrakashFounder & CEO · Together AI
- Waseem AlShikhCTO and co-founder · WRITER
- Woosuk KwonCo-founder and CTO · Inferact
- Xuan-Son NguyenSoftware engineer · Hugging Face
- Yagil BurowskiLM Studio team member (shown with the "LM Studio Team" badge on LM Studio Hub) · Element Labs (LM Studio)
- Ying ShengOfficer · LMSYS
- Younes BelkadaBuilders & open source
- Zhuohan LiAI Research Scientist · Meta
Other topics: Language models · Teaching and writing · Developer tools · Agents · ML frameworks and libraries · Datasets and data · Training systems · Evaluation and benchmarks · Chips and hardware · Computer vision · Image, video, and 3D generation · Safety and alignment · Reinforcement learning · Multimodal models · AI for science · Speech and audio · Robotics · Machine-learning theory · Interpretability