Run Time Error '-2147417851'(80010105);

[Saket]

below statements does not seem to be doing anything with your DLL. Its simply trying to find the objects existance in the AUT.

Code:

If Not CBool(CStr(JavaDialog("GTMLogin").Exist(0))) Then
SystemUtil.Run "iexplore", Environment("App_URL")
End If

May be I am not getting the whole logic with this partial piece of your dll and statements, but I guess this is the OR which is causing the issue as you mentioned commenting the statements work so it could be some conflict with objects or I suspect JavaDialog requires to have a regular/speciifc JavaDialog test object/ some other objects in the repository.
if possible paste some more info in terms of the flow/design of your framework or dll structure.