StudyBrixFree worksheets, study guides and courses

Artificial intelligence · lesson 4 of 4

AI system design, monitoring and safe tool boundaries

A useful AI application includes data handling, retrieval or model calls, validation, error handling and a user interface. The model is one component.

University8 practice questionsNotes + worked examples
Take the quizStudy guideRevision sheet

Learn the ideas

Prerequisites: Software interfaces, evaluation and data privacy.

System boundary

A useful AI application includes data handling, retrieval or model calls, validation, error handling and a user interface. The model is one component.

Tools

Actions need explicit authorization, narrowly scoped permissions and input validation. Model-generated arguments should not be trusted merely because they are structured.

Operations

Track latency, cost, failures and task-specific quality without logging unnecessary private data. Version changes and provide rollback.

Fallback

Define what happens when evidence is missing, a service fails, or output violates constraints. Human review and safe failure can be more valuable than a forced answer.

Worked examples

Example 1

Should model-generated tool arguments bypass server-side validation?

Generated arguments remain untrusted inputs requiring authorization and validation.

No

Example 2

Three sequential stages take 100,200 and 50 ms with no overlap. Find total latency.

Add sequential stage durations.

350 ms

Check your understanding

8 questions

Decimals or fractions are accepted for numeric answers. Proofs and written responses use sample answers and require human marking. This is practice, not a protected examination.

1 Should model-generated tool arguments bypass server-side validation?

Show answer and explanation

No

Generated arguments remain untrusted inputs requiring authorization and validation.

2 Three sequential stages take 100,200 and 50 ms with no overlap. Find total latency.ms

Show answer and explanation

350 ms

Add sequential stage durations.

3 Which permission design is appropriate for a tool?

Show answer and explanation

The minimum scope needed for the authorized task

Least privilege limits consequences of mistakes.

4 Why should sensitive prompt contents not automatically enter analytics logs?

Sample answer and marking guidance

Logs can retain and expose private data beyond the task. Minimize or redact content and define appropriate access and retention.

Credit privacy and retention controls.

5 A system handles 200 requests and 10 fail. Find observed failure rate.

Show answer and explanation

0.05

10/200=0.05.

6 Which is a sensible response to an unavailable evidence service?

Show answer and explanation

Show a clear failure or limited answer without inventing evidence

Failing safely is better than false success.

7 Describe a rollback plan for a model or prompt update.

Sample answer and marking guidance

Version the previous configuration, compare release tests and monitored metrics, define rollback triggers, and restore the prior version without losing necessary data integrity.

Credit versioning, triggers and restoration.

8 Why is syntactically valid JSON not enough to make an AI action safe?

Sample answer and marking guidance

Its contents can still be unauthorized, semantically wrong, outside limits or targeted at the wrong resource. Enforce meaning and permissions server-side.

Credit syntax versus authorization and semantic validation.

Further reading and review references

These are reference links, not copied exercises, institutional endorsement or proof of independent review.