There are many more things that can be done to this exception handler. How important each one is depends on your use case. I encourage you to give each one thought, but as always, release the simplest thing that works. Especially when you are dealing with error handlers, simpler is better. You don't want errors in your error handlers!
It may not be a good idea to send information about a user's machine without consent. Users should either opt in for automatic reporting (like Google Chrome automatic statistics gather), or manually approve sending the information when an error happens (like Autodesk's Customer Error Reporting system). My preference is for the latter option, which allows the user to preview the issue and submit any other information that may be helpful. The easiest way to do this is to pop up a dialog when an error happens, previewing the contents of the e-mail. This also gives you a good place to put any other customizations...