Autodesk is strengthening its operations with Splunk and AWS by using CloudTrail to log API calls across its AWS accounts and sending the logs to Splunk. This provides Autodesk with a single view of activity across all accounts for security monitoring, compliance auditing, and troubleshooting. Specifically, Autodesk can search logs to investigate incidents, identify compromised hosts, and monitor sign-in locations for security. For compliance, Autodesk can set alerts on sensitive API calls and user creations. Using CloudTrail and Splunk provides Autodesk with a scalable, cost-effective logging solution.
How to Troubleshoot Apps for the Modern Connected Worker
AWS Webcast - Splunk and Autodesk
1. Learn how Autodesk is strengthening its operations with
Splunk and AWS
Big Data Solution Showcase
Watch on demand webinar: https://connect.awswebcasts.com/p2u35o8z8ir/
2. Introductions
• Praveen Rangnath
– Director of Cloud Product Marketing, Splunk
• Alan Williams
– Principal Engineer, Autodesk
• Rahul Bhartia
– Solution Architect, Amazon Web Services
4. Big Data
Technologies and techniques for working
productively with data, at any scale.
5. Big data Cloud computing
Big data and AWS Cloud computing
• Variety, volume, and velocity
requiring new tools
• Potentially massive datasets
• Iterative, experimental style of data
manipulation and analysis
• Frequently not steady-state
workload; peaks and valleys
• Variety of compute, storage, and
networking options
• Massive, virtually unlimited capacity
• Iterative, experimental style of
infrastructure deployment/usage
• Elasticity for highly variable
workloads
6. AWS Data Services
S3 RDS Redshift DynamoDB EMR Kinesis
Data
Velocity
Variety
Volume
Structured, Unstructured, Text, Binary
Gigabytes, Terabytes, Petabytes
Millisecond, Second, Minute, Hour, Day
Data Pipeline Elasticache
7. Customer segmentation
Marketing spend optimization
Financial modeling & forecasting
Ad targeting & real time bidding
Clickstream analysis
Security and Compliance
Use Cases
8. AWS CloudTrail – Security at scale
Increase your visibility of what
happened in your AWS
environment – who did what and
when, from where
• Record access to API calls and save logs in your S3 buckets
• Be notified of log file delivery using the AWS Simple Notification Service
• Many AWS services including EC2, EBS, VPC, RDS, IAM, STS and Redshift
• Aggregate log information into a single S3 bucket
9. AWS CloudTrail logs use cases
Security Analysis - Perform security
analysis and to detect user behavior
patterns
Track Changes – Monitor creation,
modification, and deletion of AWS
resources
Compliance Aid - Ensure compliance with
internal policies and regulatory standards
by providing AWS API call history
Troubleshoot Operational Issues -
Quickly identify the most recent changes
made to resources in your environment
12. Splunk –Company Overview
Company (NASDAQ: SPLK)
Founded 2004, first software release in 2006
HQ: San Francisco / Regional HQ: London, Hong Kong
Over 1,000 employees, based in 12 countries
FY 2014 Revenue: $302M (YoY+52%)
Business Model / Products
Free download / AMI / Online Sandbox
Splunk Enterprise, Splunk Cloud
Hunk: Splunk Analytics for Hadoop
7,900+ Customers
Customers in over 100 countries
More than 2/3 of the Fortune 100
Largest license: Over 100 Terabytes per day
Mission: Make machine data accessible, usable, and valuable to everyone
12
13. What is Machine Data?
Volume | Velocity| Variety | Variability
GPS,
RFID,
Hypervisor,
Web Servers,
Email, Messaging,
Clickstreams, Mobile,
Telephony, IVR, Databases,
Sensors, Telematics, Storage,
Servers, Security Devices, AWS CloudTrail
Machinedatais the fastest growing, most complex, most valuable area of big data
14. What Does Machine Data Look Like?
14
Sources
Twitter
Care IVR
Middleware Error
Order Processing
15. Machine Data Contains Critical Insights
15
Customer ID
Order ID
Customer’s Tweet
Time Waiting On Hold
Twitter ID
Product ID
Company’s Twitter ID
Sources
Twitter
Care IVR
Middleware Error
Order Processing
Customer ID
Order ID
Customer ID
16. Machine Data Contains Critical Insights
16
Order ID
Customer’s Tweet
Time Waiting On Hold
Product ID
Company’s Twitter ID
Sources
Twitter
Care IVR
Middleware Error
Order Processing
Order ID
Customer ID
Twitter ID
Customer ID
Customer ID
17. IT
Operations
Security and Compliance
Digital Intelligence
App Devand
App Mgmt.
Developer Platform (REST API, SDKs)
Business Analytics
Industrial Data and Internet of Things
Small Data. Big Data. Huge Data.
Use Cases for Machine Data Analytics
17
Core Use Cases
Emerging Use Cases
18. Industry Leading Platform For Machine Data
Machine Data: Any Location, Type, Volume
Online Services
Web Services
Servers
Security
GPS Location
Storage
Desktops
Networks
Packaged Applications
Custom
Applications
Messaging
Telecoms
Online Shopping Cart
Web Clickstreams
Databases
Energy Meters
Call Detail Records
Smartphones and Devices
RFID
On-
Premises
Private Cloud
Public Cloud
Platform Support (Apps / API / SDKs)
Enterprise Scalability
Universal Indexing
Answer Any Question
DeveloperPlatform
Report and analyze
Custom dashboards
Monitor and alert
Ad hoc search