Hiring brief scenarios
Build the LLM Engineer brief around the work.
These scenarios connect location context to role responsibilities. Use them as prompts to verify with the employer, not as measures of Washington demand, clients, or candidate supply.
Sourced government-connected technology context
Controlled delivery and contract boundaries: LLM Engineer
The Washington DC Economic Partnership connects the District's technology sector with government agencies, private contractors, established companies, and startups. Connect the local operating context to the data that may enter prompts or retrieval. Require a candidate to explain document preparation, permissions, citation behavior, evaluation cases, and the team that approves changes. Government-connected systems may separate environments and organizations while adding procurement limits, accessibility requirements, approval records, fixed release windows, and contract handoffs.
Evidence to request: Request an evaluation set, retrieval diagram, or redacted design note that shows how the candidate tested grounding and access boundaries. Document the agency or customer boundary, hosting model, system owner, approval path, maintenance window, evidence retention, and transfer between teams.
Sourced cybersecurity context
Identity, sensitive data, and audit evidence: LLM Engineer
The partnership identifies cybersecurity as a central part of Washington's technology sector and connects the field to agencies and contractors. Set the model-selection decision around the workload rather than a preferred vendor. Ask how the engineer compared hosted and open models, measured quality, handled unsafe output, and controlled latency or token cost. Security-sensitive work can require controlled identities, least-privilege access, protected data, artifact provenance, vulnerability handling, incident records, and proof of each production change.
Evidence to request: Use a design exercise with a fixed quality target and cost limit. Score the tradeoffs, measurement plan, and fallback behavior. Name the identity authority, sensitive records, access-review owner, security gates, emergency path, retained logs, and remediation deadline attached to the system.
Sourced artificial intelligence context
Model, data, and service governance: LLM Engineer
Artificial intelligence appears as a named focus within the partnership's technology profile for Washington. Treat launch support as part of the role. The brief should cover observability, feedback review, version changes, rollback, and ownership when retrieval or model behavior produces a poor result. AI-enabled services can add model artifacts, source-data permissions, evaluation gates, cost limits, human review, monitoring, and rollback decisions to an existing business process.
Evidence to request: Ask for an incident or regression account with the signal, diagnosis, change, and post-release check the candidate owned. Clarify whether the role owns the business workflow, source data, model service, integration, evaluation, access control, monitoring, or incident response.