StudyBrixFree worksheets, study guides and courses

Artificial intelligence · University

Output of a scalar ReLU unit

This asks for a forward pass, not the derivative at the nondifferentiable point zero.

Make a worksheet

Method and conditions

This asks for a forward pass, not the derivative at the nondifferentiable point zero.

ReLU(z) = max(0,z)

Worked examples

A neuron computes ReLU(wx+b) with w=3, x=-6, b=-3. Find its output. Round the final result to 4 decimal places if needed.

The preactivation is -21. Keep that number if positive; otherwise return 0.

0

A neuron computes ReLU(wx+b) with w=2, x=-3, b=-1. Find its output. Round the final result to 4 decimal places if needed.

The preactivation is -7. Keep that number if positive; otherwise return 0.

0

Try it

  1. A neuron computes ReLU(wx+b) with w=1, x=5, b=0. Find its output. Round the final result to 4 decimal places if needed.

  2. A neuron computes ReLU(wx+b) with w=6, x=-9, b=-9. Find its output. Round the final result to 4 decimal places if needed.

Check your work

Answers and marking notes
  1. 5

    The preactivation is 5. Keep that number if positive; otherwise return 0.

  2. 0

    The preactivation is -63. Keep that number if positive; otherwise return 0.

Further reading and review references

These are reference links, not copied exercises, institutional endorsement or proof of independent review.

AI-assisted preview; independent educational review required. Level labels describe prerequisites, not accreditation or official curriculum alignment.