Carefully removing? You mean press Enter gently after typing DROP INDEX? Err, no!
The thinking is that it takes a long time to build an index, and a short time to drop it.
What we want is a way of removing an index such that if we discover that removing it was a mistake, we can put the index back again quickly.