Objective
The primary objective was to develop a prototype application that could analyze vast amounts of location and Netflow data, identify patterns of interest, and visualize these patterns for intelligence analysts. The tool needed to be user-friendly, allowing analysts to quickly filter and combine different behavioral traits to uncover potential areas of concern or interest, such as suspicious activities or the planning of criminal acts.
Outcome
The U.S. government intelligence agency was highly impressed with the prototype. The application demonstrated the ability to quickly analyze and visualize complex patterns of movement, providing valuable insights into the behavior of groups of interest. The tool’s potential for uncovering suspicious activities and supporting national security efforts was recognized, marking the project as a significant success.
This case study highlights the team’s expertise in data analytics and application development, showcasing their ability to create powerful tools for intelligence and defense, enabling clients to gain critical insights from vast and complex data sets.ChatGPT Case Study 600 Characters or Less
Michael Orlando worked on Project Spruce, an analytics application that tracked global movement patterns to identify behaviors of interest. The tool allowed analysts to explore and combine location and web behavior data, uncovering patterns such as where specific customer groups went before and after visiting certain locations. Handling terabytes of data, the application used Tableau for prototyping and provided rapid, detailed insights, aiding decision-making in both national security and commercial sectors.
Challenges
- Data Volume: Managing hundreds of terabytes of location observation and Netflow data required efficient data processing and optimization to ensure the application could deliver results quickly.
- Complexity of Patterns: The application needed to identify and visualize complex patterns of movement and behavior across various groups and combinations of traits.
- Performance: The goal was to reduce the data to a format that could be visualized on a web page, loading in under a minute, despite the vast volume of information.
Solution
The team, led by Michael, developed a prototype application that met the project’s objectives. The application identified users with specific traits, such as “visited certain retail stores” or “frequents shopping malls,” and plotted these users on a map to observe their movements. Analysts could create and combine preset groups to see patterns, such as individuals who visited both a specific retail store and a coffee shop on certain days.
- Data Modeling and Visualization: Tableau was used to prototype and visualize the patterns, aiding in the development of the data model that powered the application.
- Application Development: The team developed the HTML, JavaScript, and server-side components of the application, ensuring it was responsive and capable of handling large data sets efficiently.