Methods of identification through point and click and using the navigator works most of the time to find the elements that we need to interact with. They work especially well if the application is installed on the same computer as the robot. However, we are seeing more and more technologies that work off a remote machine. The application is installed on a server somewhere in the network and what is sent to your computer is just an image that you can interact with. Examples of such applications (also known as thin-clients) include Citrix, Microsoft Terminal Services, and Mainframes.
In such special cases, we need to fall back on the good old method of looking at the position of the element on the screen to figure out where they are. This method of spying is also known as surface automation. The spy mode that supports surface automation is region...