Stopping the world refers to the need to halt a thread that is executing application code. This may be needed for internal runtime work. An example of such work is non-concurrent garbage collection. This is a major source of latency in an application. Another source of latency is the application itself when it does things other than execute code, such as waiting for I/O.
See also Latency.