In this lab, you'll learn how to trace automated scanning and scraping activities. We will analyze the OSI layer limitations of different log sources to pinpoint exactly where malicious HTTP headers are recorded in a real SOC environment.
You are an L2 Analyst monitoring the perimeter for "RetailCore", an e-commerce platform hosted in AWS. Recently, the marketing team reported severely skewed web analytics, and the DevOps team noted that database CPU usage has spiked by 40% during off-peak hours.
You suspect automated scraping or brute-forcing activity targeting the product API and login endpoints. You need to pull the correct logs into your SIEM (Splunk) to build a detection query for these automated tools.
You have access to a centralized logging infrastructure. A quick raw search in the SIEM reveals the following snippet associated with the suspected attack window:
*Review the terminal output above to determine which infrastructure component generated this specific log format.*
Which of the following data source can be used to detect the traffic associated with Bad Bot User-Agents?
What is happening?
The SOC is hunting for automated malicious software (bots). When a bot connects to a server, it sends an HTTP request. Part of that request is the User-Agent header, which tells the server what client software is being used (e.g., Mozilla Firefox, curl, python-requests). Attackers frequently fail to change default User-Agents in their scripts, making them highly visible.
Why Option B is Correct:
Web Servers (like Nginx, Apache, or IIS) are Layer 7 applications. They natively terminate HTTP connections, parse the HTTP headers, and write the details—including the Source IP, HTTP Method, URI, Status Code, and the User-Agent—directly into their access logs. This makes Web Server logs the primary data source for hunting malicious User-Agents.
Why the others are wrong:
In a real-world SIEM environment (like Splunk or Sentinel), searching for known bad User-Agents like sqlmap or Nmap Scripting Engine is a solid L1 tactic. However, advanced attackers will spoof their User-Agent to look like a standard Google Chrome browser.
How do Senior Analysts catch them?
We use correlation and baselining. We look for:
Ready to sharpen your defensive skills further?
Explore more CSA simulations