[Troubleshooting] Mouse is showing lights even the PC is turned off?

Hello members,
My mouse is showing LED light even the PC is turned off? The same case is with my keyboard also. Do I need to turned it off from the main power outlet also to rectify this thing? Kindly give your suggestions. Advance thanks!!