Under the Options tab, a tester has the following options:

• Crawler Settings: It provides the ability to regulate the number of links deep Spider will follow; also identifies basic web content to Spider for on a website such as the robots.txt file:

• Passive Spidering: Spiders newly-discovered content in the background and is turned on by default: 

• Form Submission: It provides the ability to determine how Spider interacts with forms. Several options are available including ignore, prompt for guidance, submit with default values found in the table provided, or use an arbitrary value (for example, [email protected]):

• Application Login: It provides the ability to determine how Spider interacts with login forms. Several options are available, including ignore, prompt for guidance, submit as standard form submission, or use credentials provided in text boxes:

• Spider Engine: It provides the ability to edit the number of threads used along with retry attempt settings due to network failures. Use the number of threads judiciously as too many thread requests could choke an application and affect its performance:

• Request Headers: It provides the ability to modify the way the HTTP requests look originating from Burp Spider. For example, a tester can modify the user agent to have Spider look like a mobile phone: