Hiring brief scenarios
Build the LLM Engineer brief around the work.
These scenarios connect location context to role responsibilities. Use them as prompts to verify with the employer, not as measures of San Francisco demand, clients, or candidate supply.
Sourced artificial intelligence context
AI product and research activity: LLM Engineer
San Francisco's economic-development page reports that city-based companies attracted $34.3 billion in venture funding in 2023 and attributes more than 20 percent of United States AI job postings to the area for that period. These dated figures describe the wider market, not current openings or Crosscheck activity. Connect the local operating context to the data that may enter prompts or retrieval. Require a candidate to explain document preparation, permissions, citation behavior, evaluation cases, and the team that approves changes. AI product teams may change model providers, evaluation methods, and data controls while they move from prototypes to supported services.
Evidence to request: Request an evaluation set, retrieval diagram, or redacted design note that shows how the candidate tested grounding and access boundaries. Define the product stage, model boundary, data rights, evaluation owner, and production service level before comparing candidate backgrounds.
Sourced financial district context
Financial and enterprise systems: LLM Engineer
The City and County of San Francisco identifies the Financial District and the Market Street transit spine as core downtown business areas. The geography supports a financial or enterprise systems scenario, but it does not identify a specific employer or vacancy. Set the model-selection decision around the workload rather than a preferred vendor. Ask how the engineer compared hosted and open models, measured quality, handled unsafe output, and controlled latency or token cost. Enterprise finance work can involve high-value records, role-based access, reporting deadlines, and integrations with older platforms.
Evidence to request: Use a design exercise with a fixed quality target and cost limit. Score the tradeoffs, measurement plan, and fallback behavior. Ask which transactions, users, controls, and downstream reports the role supports and whether office presence follows a stated operating need.
Sourced mission bay and research context
Life-sciences data and operations: LLM Engineer
San Francisco's economic-development page identifies Mission Bay as one of the city's growing office and industry clusters. Mission Bay contains research and health institutions, so employers may need technical staff who can work with scientific, clinical, or operational systems. Treat launch support as part of the role. The brief should cover observability, feedback review, version changes, rollback, and ownership when retrieval or model behavior produces a poor result. Research and health data can require validation, controlled access, lineage, and communication with scientists or clinical staff.
Evidence to request: Ask for an incident or regression account with the signal, diagnosis, change, and post-release check the candidate owned. Determine whether domain experience is mandatory and name the validation or data-governance artifact a candidate must explain.