Solution:
The satellite is held in orbit because of two forces. One is the gravitational force and the second is the centrifugal force. When the gravitational force disappears, there is no force to hold it in orbit. So it moves in the direction of its velocity, which is tangential to the circular path it was describing earlier.