Role overview
One role, accountable for medical LLMs end to end
This is the company’s lead technical role for large models: you will own the full chain of medical LLM work — design, training, alignment, development and engineering deployment — and be responsible for building our general-purpose foundation capabilities.
Mission
Within three years: medical LLMs that are clinically usable, compliant to launch and proven by evidence
At the same time, you will build a general-purpose foundation model and an R&D organization that keep improving release after release. The role carries four mandates:
- Technical direction: Decide the foundation-model strategy — in-house pre-training, continued pre-training on open-source models, or a hybrid — and set the pace of investment in compute and data.
- Medical deployment: Bring models into real clinical care, hospital operations, medical insurance and drug and device R&D, and complete the required regulatory filings.
- Organization building: Build and lead a world-class LLM R&D team from zero to one.
- External influence: Represent the company to academia, industry, healthcare institutions and regulators.
Three-year roadmap
Build the foundation and complete filings, scale commercially, then set the industry benchmark
Three phases and two gates. Phase targets are planning goals and will be adjusted as the work progresses.
| Phase | Timing | Key objectives | Gate |
|---|---|---|---|
| Year 1 · Foundation | Months 0–12 |
| Gate 1 Regulatory filing completed; first scenario live |
| Year 2 · Scale | Months 13–24 |
| Gate 2 Core scenarios in large-scale commercial use |
| Year 3 · Leadership | Months 25–36 |
| — |
Responsibilities
Ten areas of responsibility
The Chief Scientist is accountable for the design, training, alignment, development, engineering and compliant launch of our medical LLMs.
01Technical strategy and roadmap
- Set a three-year technical roadmap for general-purpose and medical LLMs, including the foundation-model choice: in-house pre-training, continued pre-training of open-source models, distillation, and dense versus MoE architectures.
- Assess frontier directions: reasoning models, reinforcement learning, multimodality, agents, long context and small on-device models.
- Plan the budget and pacing of the three core resources: compute (GPUs and domestic Chinese accelerators), data and talent.
02General-purpose foundation models
- Lead pre-training and continued pre-training: data mixture, tokenizer, model architecture, scaling-law experiments and training stability.
- Lead post-training: SFT, preference alignment (RLHF and DPO-style methods), reinforcement learning with verifiable rewards, and long chain-of-thought reasoning.
- Keep the foundation model competitive on general capabilities — knowledge, reasoning, code, long context and tool use.
03Medical LLM design and training
- Build the medical model portfolio: medical Q&A, clinical decision support, medical-record generation and quality control, medication review, report interpretation, patient communication and medical-insurance cost control.
- Build the medical corpus and knowledge system — textbooks, clinical guidelines, literature, drug labels, de-identified electronic medical records and medical knowledge graphs — with standards for cleaning, de-identification and quality.
- Design evidence and safety mechanisms — source attribution, expression of uncertainty, refusal and referral policies — to reduce hallucination systematically.
- Advance medical multimodality: joint modeling of medical imaging, pathology, ECG and laboratory data with text.
04Alignment, fine-tuning and safety
- Establish a physician-in-the-loop annotation, review and feedback cycle (RLHF with medical experts).
- Build medical safety guardrails: interception of high-risk advice, red-teaming, bias and fairness evaluation, and defense against adversarial attacks.
- Define standards for model interpretability and traceability.
05Training and inference engineering
- Lead distributed training at the scale of 1,000+ accelerators (Megatron-LM, DeepSpeed, FSDP, etc.), improving efficiency, stability and fault tolerance.
- Lead inference optimization (vLLM, SGLang, TensorRT-LLM, quantization, speculative decoding, etc.) for cloud, private and on-premises hospital deployment.
- Drive adaptation to domestic Chinese accelerators and China’s domestic IT stack (Xinchuang).
- Build four platforms — data, training, evaluation and model serving (LLMOps).
06Applications: agents, RAG and productization
- Design the medical agent framework: tool use, multi-agent collaboration and integration with hospital information systems such as HIS, EMR, PACS and LIS.
- Build medical retrieval-augmented generation (RAG) and knowledge bases covering guidelines, literature and in-hospital knowledge, with retrieval and citation.
- Work with product and delivery teams to turn model capabilities into products that can be delivered at scale.
07Evaluation
- Establish two-tier evaluation — general and medical: public benchmarks (MedQA, MedMCQA, PubMedQA, CMB, CMExam, MedBench, HealthBench, etc.), in-house clinical-scenario evaluations and blinded physician review.
- Put in place safeguards against data contamination, production monitoring and continuous iteration.
08Compliance and regulation
- Lead algorithm filing, launch filing and security assessment for generative AI services.
- Where needed, drive registration of medical AI products as medical-device software with the NMPA.
- Ensure compliance with China’s Interim Measures for the Management of Generative AI Services, the Data Security Law and the Personal Information Protection Law, including de-identification and secure management of medical data.
09Team and organization
- Build five teams — algorithms, data, engineering, evaluation and medicine — with clear talent standards and succession.
- Establish R&D processes, experiment management, technical review and knowledge management.
10External partnerships and influence
- Run joint R&D and clinical validation with top-tier (Grade 3A) hospitals, medical schools and research institutes.
- Publish at top conferences and journals, and contribute to industry standards and white papers.
- Support fundraising roadshows and technical defenses for major clients and government projects.
Requirements
Five requirements
Education, publications, technical depth, healthcare knowledge and leadership all matter. Institutional background is a reference point for screening; achievements weigh more.
Requirement 1Education and institutions
A PhD in an AI-related field is required. Institutions are grouped into tiers: Tier A is preferred; Tier B requires publications or industry achievements that meet the next requirement’s thresholds; Tier C is equally welcome when achievements are at Tier A level.
- PhD discipline
- Computer science, artificial intelligence, electrical engineering, automation, mathematics/statistics, biomedical engineering or medical informatics
- PhD research area
- Natural language processing, machine learning, deep learning, reinforcement learning, multimodal learning/computer vision or medical AI
| Tier | Undergraduate institution | Doctoral institution | How we assess |
|---|---|---|---|
| Tier A (preferred) | Tsinghua, Peking, USTC, Zhejiang, Shanghai Jiao Tong, Fudan, Nanjing; MIT, Stanford, CMU, UC Berkeley, Princeton, Harvard, Caltech, Oxford, Cambridge | Tsinghua, Peking, USTC; MIT, Stanford, CMU, UC Berkeley, Princeton, Cornell, University of Washington, UIUC, ETH Zurich, Oxford, Cambridge, Toronto | Preferred |
| Tier B | Leading “Project 985” universities such as Harbin Institute of Technology, Xi’an Jiaotong, Beihang, Huazhong University of Science and Technology, Wuhan and Sun Yat-sen; HKU, HKUST, CUHK | Zhejiang, Shanghai Jiao Tong, Fudan, Nanjing, Harbin Institute of Technology, institutes of the Chinese Academy of Sciences; HKU, HKUST, CUHK; NUS, NTU, UCLA, UCSD, Columbia, Michigan, UT Austin, Georgia Tech, EPFL, Edinburgh, UCL, Max Planck institutes | Publications or industry achievements meet the “Publications and academic impact” thresholds |
| Tier C (exception) | Other institutions | Other institutions | Publications or industry achievements at Tier A level |
- Plus: combined background
- An undergraduate degree in clinical medicine or an MD (for example, an eight-year program at Peking Union Medical College, Peking University Health Science Center, Fudan Shanghai Medical College or West China) plus a PhD in computing.
- Plus: postdoctoral or visiting research
- Postdoctoral or visiting research experience at a leading overseas university or a top industrial lab.
- Flexibility
- For industry leaders who have led the training and launch of models with 10B+ parameters at a leading organization, the institutional requirement can be relaxed by one tier.
Requirement 2Publications and academic impact
You must meet the thresholds of either the academic track or the industry track. Only papers formally accepted at the venues listed below count.
| Metric | Academic track · minimum | Academic track · ideal | Industry track · minimum |
|---|---|---|---|
| First-author or corresponding-author papers at top venues | ≥ 8 | ≥ 15 | ≥ 3 |
| Papers directly on large models in the past 3 years | ≥ 3 | ≥ 6 | ≥ 1 |
| Total Google Scholar citations | ≥ 2,000 | ≥ 10,000 | No threshold |
| h-index | ≥ 20 | ≥ 35 | No threshold |
| Representative work | A representative work on large models or medical AI | A single paper with ≥ 1,000 citations, or a paper in a top medical-AI journal | A model you led, with a public technical report or benchmark results |
“Directly on large models” covers pre-training, alignment and reinforcement learning, reasoning, multimodality, agents and medical LLMs. The industry track is assessed mainly on model training and deployment results.
Recognized conferences and journals
| Field | Recognized conferences and journals |
|---|---|
| Machine learning | NeurIPS, ICML, ICLR, JMLR |
| Natural language processing | ACL, EMNLP, NAACL, TACL |
| Computer vision / multimodal | CVPR, ICCV, ECCV, IEEE TPAMI |
| General AI | AAAI, IJCAI |
| Data mining and retrieval | KDD, WWW, SIGIR |
| Medical imaging / medical AI | MICCAI, IEEE TMI, Medical Image Analysis |
| Multidisciplinary and medical journals | Nature, Science, Cell and their sister journals (Nature Medicine, Nature Machine Intelligence, Nature Biomedical Engineering, Nature Communications, etc.), NEJM AI, The Lancet Digital Health, npj Digital Medicine, the JAMA Network journals |
- Additional credit for academic impact
- Best or outstanding paper awards at top conferences; area chair (AC/SAC) at top conferences or editorial board membership; IEEE or ACM Fellow, or selection for a national talent program; high-impact open-source projects with significant usage on GitHub or Hugging Face.
- How we verify
- We check papers, author order and citation counts on Google Scholar, DBLP and Semantic Scholar.
- We distinguish formal acceptance from arXiv preprints, main conferences from workshops, and long papers from short papers and Findings.
- Please mark co-first authorship; corresponding authorship follows the published byline.
Requirement 3Technical depth and project experience
You must have led — as the technical owner — at least one complete training run of a model with 7B+ parameters, from data to production. Ideally, you have led models with tens to hundreds of billions of parameters, or large-scale MoE models.
Experience
- 10+ years in AI research and development (including doctoral studies), of which 3+ years on large models.
- 5+ years managing technical teams, including an R&D team of 30 or more.
Core technical capabilities
- Pre-training: Data engineering (cleaning, deduplication, quality scoring, mixture design, synthetic data); model architecture (Transformer variants, MoE, long context); scaling laws; training stability (for example, handling loss spikes).
- Post-training: SFT, RLHF/RLAIF, DPO-style methods, reinforcement learning with verifiable rewards, long chain-of-thought reasoning training and model distillation.
- Multimodality: Vision-language models; alignment and joint modeling of medical images and text.
- Agents and RAG: Tool use, planning and memory, multi-agent collaboration; retrieval augmentation combined with knowledge graphs.
- Training engineering: Training on GPU clusters of 1,000+ cards: data, tensor and pipeline parallelism, ZeRO, mixed precision, fault tolerance and checkpoint resumption.
- Inference engineering: Quantization, KV-cache optimization, speculative decoding and high-concurrency serving; experience with domestic Chinese accelerators is a plus.
- Evaluation methodology: Designing trustworthy evaluation sets and processes, and detecting and preventing data contamination.
- Hands-on
- You read and modify code, and can diagnose problems from loss curves and evaluation results. Purely managerial candidates who have been away from hands-on work for years will not be considered.
- Project details you should be ready to discuss
- Model size and architecture, training data volume (tokens), compute (number of accelerators × duration), key hyperparameters and lessons from failures, and core metrics after launch.
Requirement 4Healthcare knowledge and industrialization
You must have led at least one AI product or project in real use at a healthcare institution, and be able to explain the change in business metrics it delivered.
- Clinical operations: Understanding of clinical workflows, electronic medical record structure and clinical guidelines; familiarity with medical terminology and coding systems (ICD-10, SNOMED CT, LOINC, etc.); knowledge of hospital information systems such as HIS, EMR, PACS and LIS.
- Medical data: Familiarity with medical data governance, de-identification, and privacy-preserving computation or federated learning.
- Clinical validation: Understanding of retrospective and prospective clinical study design; able to co-design evaluation protocols with physician teams.
- Compliance and regulation: Knowledge of China’s generative-AI filing requirements and medical-device software registration with the NMPA; experience with FDA (SaMD), HIPAA and other overseas regimes is a plus.
- Industrial deployment: Experience delivering with top-tier (Grade 3A) hospitals, pharmaceutical companies, insurers or medical-insurance agencies, with quantified results — for example, changes in documentation time, quality-control accuracy or diagnostic agreement.
Exception: Candidates whose general LLM capability is at Tier A but whose medical experience is limited are welcome to apply: interviews will focus on learning agility, and the company will provide a senior medical team.
Requirement 5Leadership and personal qualities
The role calls for sound technical trade-offs, the ability to bring top talent together, and full ownership of results.
- Strategic judgment: Make trade-offs under compute and funding constraints, and explain clearly what to do — and what not to do.
- Organization building: A track record of building teams from zero to one, and the ability to attract top talent.
- Cross-disciplinary communication: Communicate effectively with physicians, regulators, investors and senior client executives.
- Results orientation: Aim for deliverable, production-ready results — not only publications.
- Integrity: Strict adherence to data security and medical ethics, with no record of academic misconduct.
- Languages: Able to work in both Chinese and English, and to present at international academic venues.
Preferred qualifications
None of the following is required; the more you bring, the stronger your candidacy
- Core author or technical lead on a well-known open-source LLM or medical LLM.
- A combined medicine and computing background (an undergraduate degree in clinical medicine or an MD, plus a PhD in computing).
- A best or outstanding paper award at a top international conference, or area chair at a top conference.
- IEEE or ACM Fellow, or selection for a national talent program.
- Led a medical AI product that obtained NMPA Class III medical-device registration or FDA authorization.
- Core R&D experience at a top industrial lab such as Google DeepMind, OpenAI, Meta or Microsoft Research.
- Entrepreneurial or successful commercialization experience, with an understanding of fundraising and capital markets.
Ideal candidates
Three profiles we are looking for
Our first choice is a candidate who combines industrial LLM training capability with a track record in medical AI. Next is Profile A. For Profile B, the company will pair you with a strong engineering deputy.
| Profile | Typical background | Core strengths | What interviews focus on |
|---|---|---|---|
| A · Industrial LLM leader | Head of foundation-model, post-training or multimodal work at a leading Chinese LLM company, having led models with 10B+ parameters | Strongest hands-on training and engineering capability | Depth of medical understanding; whether you led the work or contributed to it |
| B · Academic leader in medical AI | Professor or research scientist at a top university or institute, with a strong record at top medical-AI venues and a network of hospital partners | Academic influence and medical resources | Large-scale training and engineering delivery; ability to join full-time |
| C · Returning scientist from overseas | Senior research scientist at a top overseas industrial lab or major technology company, having contributed to frontier general-purpose or medical models | International perspective and frontier methods | Domestic compliance and local delivery; willingness to relocate to China and start date |
What we offer
Compensation and resources
Cash compensation, equity and signing bonus are determined in discussion, with no upper limit.
- Compensation
- RMB 2–5 millionAnnual cash compensation with no upper limit, plus equity/options and a signing bonus, determined in discussion.
- Authority
- Roadmap · team · budgetDecision rights over the technical roadmap, authority to build the team, and an annual R&D budget.
- Compute
- 500PGPU and domestic-accelerator compute capacity, existing and planned.
- Medical data
- Nationwide dataMedical data and partnership resources with nationwide coverage.
- Company stage
- Angel roundRMB 80 million raised in the angel round.
- Academic support
- Joint appointmentsOpportunity for joint appointments with Tsinghua University, Xi’an Jiaotong University, Peking University, Harbin Institute of Technology and Sun Yat-sen University.
Assessment and process
Six assessment dimensions, eight steps
Technical depth carries the most weight; the process assesses technology, medicine, strategy and leadership together.
Assessment dimensions and weights
| Dimension | Weight | How we assess |
|---|---|---|
| Technical depth (training, alignment, engineering) | 30% | Walk through one complete LLM training run, with deep questions on data mixture, failure cases and loss anomalies |
| Medical understanding and deployment | 20% | Walk through one medical scenario from requirements to launch |
| Technical strategy | 20% | Case presentation: propose a three-year medical LLM roadmap for a given compute and funding budget |
| Leadership and organization | 15% | Team-building experience, key hires and conflict resolution |
| Academic impact | 10% | Presentation of representative work and peer assessment |
| Motivation and cultural fit | 5% | Reasons for joining and long-term commitment |
Interview process
- Résumé screeningAssessment against the requirements and the self-check list.
- Technical interviewAbout 90 minutes with the CTO or an external technical advisor, going deep into your technical work.
- Research talkA one-hour presentation of your representative work, followed by Q&A.
- Case presentationThe topic is shared one week in advance; you present a three-year medical LLM strategy on site.
- Medical expert interviewExternal clinical experts assess your medical understanding and communication.
- CEO / Chairman interviewStrategy, culture and values.
- Background checkEducation, publications, reasons for leaving, references from former employers and peers, and non-compete review.
- OfferOffer letter issued.
Before you apply
Check yourself against these eight points
If you do not meet a hard requirement, please explain why in your email.
- A PhD, with an institutional background that meets the education requirement
- Publications that meet the thresholds of either track (we verify author order and venues on Google Scholar and DBLP)
- Led a complete training run of a 7B+ model through to production, and can state the data volume, compute scale, training duration and key metrics
- A medical AI deployment, with the partner healthcare institutions and quantified results (or you meet the exception for medical experience)
- Led an R&D team of 30 or more
- No non-compete restriction, or one whose scope and term can be managed
- Compensation expectations within this role’s range
- Able to join full-time, with a clear start date
This role is probably not a fit if
- You contributed to, but did not lead, LLM training, and cannot explain the technical details under questioning.
- Your publications are mainly workshop papers, preprints or low-tier journals, or mostly in late author positions.
- Your role has been purely managerial, without hands-on technical work for years.
- Your experience is limited to application-layer work such as prompt engineering or RAG integration, without training or fine-tuning.
- You have any record of academic misconduct or data-compliance violations.
- You are seeking only a part-time or nominal role (advisory arrangements can be discussed separately).
How to apply
Please email the following materials to our recruiting contact
- Contact
- Zhang Xia
- echo@hxallai.com
- Email subject
- Application: Chief Scientist, LLMs – Your Name
Please include
- Your CV (in English or Chinese)
- A publication list marking formal acceptance vs. preprint; main conference vs. workshop or Findings; and first, co-first or corresponding authorship — with your Google Scholar link
- A summary of one or two representative model projects: model size and architecture, training data (tokens), compute (accelerators × duration), key hyperparameters and lessons from failures, and core post-launch metrics
- A summary of your medical AI deployment: partner institutions and quantified results
- Your non-compete status and earliest start date
If you are bound by a non-compete agreement, please tell us its scope, term and compensation at first contact.