Hiring brief scenarios
Build the LLM Engineer brief around the work.
These scenarios connect location context to role responsibilities. Use them as prompts to verify with the employer, not as measures of Madison demand, clients, or candidate supply.
Sourced information technology, health it, and gaming context
Clinical data and interactive products: LLM Engineer
The City of Madison's economic-development strategy identifies information technology as a target sector, with a specific focus on health IT and gaming. Connect the local operating context to the data that may enter prompts or retrieval. Require a candidate to explain document preparation, permissions, citation behavior, evaluation cases, and the team that approves changes. Health and game products can require very different evidence across protected records, identity, clinical workflows, real-time services, content, telemetry, release cadence, and user safety.
Evidence to request: Request an evaluation set, retrieval diagram, or redacted design note that shows how the candidate tested grounding and access boundaries. State whether the work supports care, administration, a game, or a shared platform, then name the data, user interaction, latency, access model, release cycle, safety check, and support owner.
Sourced biotechnology context
Research, laboratory, and product evidence: LLM Engineer
Madison's CONNECT MADISON strategy identifies biotechnology as one of the city's four target economic sectors. Set the model-selection decision around the workload rather than a preferred vendor. Ask how the engineer compared hosted and open models, measured quality, handled unsafe output, and controlled latency or token cost. Biotechnology work can cross experiments, samples, instruments, laboratory systems, genomic or clinical data, reproducibility, validation, regulated products, and manufacturing transfer.
Evidence to request: Use a design exercise with a fixed quality target and cost limit. Score the tradeoffs, measurement plan, and fallback behavior. Name the scientific or product question, sample and data lineage, instrument interface, reproducibility test, protected boundary, validation record, transfer step, and approving scientist or quality owner.
Sourced food systems and precision manufacturing context
Traceable products and custom production: LLM Engineer
The Madison strategy also targets food systems and precision manufacturing, with precision-manufacturing attention to custom fabrication and bicycle-related equipment. Treat launch support as part of the role. The brief should cover observability, feedback review, version changes, rollback, and ownership when retrieval or model behavior produces a poor result. These settings may join recipes or engineering definitions, source materials, production orders, equipment, lots or serials, quality checks, inventory, suppliers, and delivery.
Evidence to request: Ask for an incident or regression account with the signal, diagnosis, change, and post-release check the candidate owned. Trace the food or fabricated product from specification and source material through production, inspection, traceability, inventory, shipment, exception, and cost, with each control owner.