Sony PlayStation Portable PSP-1004 Instruction Manual page 28

Turning the system off
1
Hold the POWER/HOLD switch in the up position for more
than three seconds.
The POWER indicator flashes and then turns off, indicating that the
system is turned off.
28
Turning the PSP® system on and off