You can literally run a web spider from inside Excel.

APIs

• Microsoft HTML Object Library (MSHTML.tlb)
  • this corresponds roughly to the DOM
• Microsoft Internet Controls (ShDocVw.dll)
  • InternetExplorer object
  • WebBrowser object
• Microsoft Shell Controls and Automation (shell32.dll)
  • ShellWindows object
• other APIs

• How do you inject Javascript into a specific page? [1]
• How do you set the focus to a specific browser tab? [1] [2] [3]
• How do you simulate UI events? There's the FireEvent/CreateEventObject APIs, but how do you actually use them? [1]
• Is there any possible way to respond to events? VBA doesn't have delegates/callbacks. [1]("WithEvents") [2]

Other resources

• at tushar-mehta.com
• mshtml-emersion.blogspot.com