Why GlassFish stops when I stop the remote debugging

I am developing jee application. I am using GlassFish 3.1.2 , and I've set up remote debugging and it is working well. But my problem is that when I want to change some server code ,and I stop the debugger for that, it can not start again because GlassFish stops every time I stop the remote debug! and I have to restart GlassFish again every time I change something in the code ! Any idea about the solution ?

Thanks, Shadi