Hiring brief scenarios
Build the ML Engineer brief around the work.
These scenarios connect location context to role responsibilities. Use them as prompts to verify with the employer, not as measures of San Francisco demand, clients, or candidate supply.
Sourced artificial intelligence context
AI product and research activity: ML Engineer
San Francisco's economic-development page reports that city-based companies attracted $34.3 billion in venture funding in 2023 and attributes more than 20 percent of United States AI job postings to the area for that period. These dated figures describe the wider market, not current openings or Crosscheck activity. Tie the sector scenario to a concrete outcome and data-generating process. Ask how the engineer would detect label leakage, sampling bias, missing history, and a metric that looks strong but fails the business use case. AI product teams may change model providers, evaluation methods, and data controls while they move from prototypes to supported services.
Evidence to request: Review a feature or training pipeline and ask the candidate to trace one record from source through validation, training, and evaluation. Define the product stage, model boundary, data rights, evaluation owner, and production service level before comparing candidate backgrounds.
Sourced financial district context
Financial and enterprise systems: ML Engineer
The City and County of San Francisco identifies the Financial District and the Market Street transit spine as core downtown business areas. The geography supports a financial or enterprise systems scenario, but it does not identify a specific employer or vacancy. Define the inference environment before screening. Batch scoring, low-latency APIs, edge deployment, and analyst-facing tools require different software design and operating evidence. Enterprise finance work can involve high-value records, role-based access, reporting deadlines, and integrations with older platforms.
Evidence to request: Use a production scenario with throughput, latency, and reliability limits. Require an API or batch design plus a test plan. Ask which transactions, users, controls, and downstream reports the role supports and whether office presence follows a stated operating need.
Sourced mission bay and research context
Life-sciences data and operations: ML Engineer
San Francisco's economic-development page identifies Mission Bay as one of the city's growing office and industry clusters. Mission Bay contains research and health institutions, so employers may need technical staff who can work with scientific, clinical, or operational systems. Assign responsibility for drift, retraining, and model retirement. Candidates should explain the thresholds, review cadence, and human decision that follows an alert. Research and health data can require validation, controlled access, lineage, and communication with scientists or clinical staff.
Evidence to request: Ask for a model degradation example and the evidence used to separate data change, code change, and user-behavior change. Determine whether domain experience is mandatory and name the validation or data-governance artifact a candidate must explain.