It's safe, but I don't know that it will work.

I've had both battery and AC adapter issues, so I have had all kinds of configurations trying to deal with my power issues, and I know I have had the device plugged in while the battery is out. It won't damage it to try, but I don't think it will actually turn on. Tell us what happens!