Press F7 to open the Layer panel. Make sure the white box adjacent to the Gradient Map icon is selected.
We are going to fill the rectangular box with black color. As black is our current foreground color, we just need to press Alt+Backspace/Opt+Delete to fill it with black color. Once done, the image will revert back to its colored form.