DevOps with Camel, ActiveMQ, Fabric8 and HawtIO
•
22 likes•12,027 views
DevOps and Continuous Delivery slides with Fabric8 (http://fabric8.io), HawtIO (http://hawt.io), Camel, ActiveMQ, Docker Jenkins, etc.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to DevOps with Camel, ActiveMQ, Fabric8 and HawtIO
Similar to DevOps with Camel, ActiveMQ, Fabric8 and HawtIO (20)
More from Christian Posta
More from Christian Posta (20)
Recently uploaded
Recently uploaded (20)
DevOps with Camel, ActiveMQ, Fabric8 and HawtIO
- 1. DevOps with ActiveMQ, Camel, Fabric8 and HawtIO Christian Posta 6/11/14
- 2. RED HAT | ADD NAME2 Agenda • DevOps… What is that? • Enterprise Integration • Automated Delivery • To the Cloud
- 3. RED HAT | ADD NAME3 Your speaker Christian Posta http://christianposta.com/blog @christianposta christian@redhat.com • Principal Middleware Specialist • Based in Phoenix, AZ • Committer on Apache Camel, ActiveMQ, Apollo, PMC on ActiveMQ • Author: Essential Camel Components DZone Refcard
- 4. Shorten the lifecycle from inception to production so that the business can make money! Developers and Operations must cooperate. Rely on tools/frameworks to automate, automate, and automate.
- 5. DevOps
- 6. RED HAT | ADD NAME6 “WTF is DevOps?” • IT is a core competency • Set of principles • There’s more to applications than coding! • Feedback • Repetition • Communication • People!
- 7. RED HAT | ADD NAME7 Shorten the feedback loop • Developers • QA • Operations • Business • Customers!!!
- 9. RED HAT | ADD NAME9 Integration is easy!
- 10. RED HAT | ADD NAME10 • Off the shelf? Home Grown? Acquisition? • Platforms • Protocols / Data Formats • Data Formats • Timing • Organizational mismatch Why is integration hard?
- 11. RED HAT | ADD NAME11 • Light-weight integration library • Domain Specific Language • Enterprise Integration Patterns • Components • Routing and Mediation (like an ESB?) • Runs in any container (or stand alone) What is Apache Camel?
- 12. RED HAT | ADD NAME12 • Message Routing • Transformation • Aggregation • Splitting • Resequencer • Routing Slip • Enricher • All 65 from the book! Enterprise Integration Patterns
- 13. RED HAT | ADD NAME13 Components • ActiveMQ, Websphere, Weblogic (JMS) • AMQP • ATOM feeds • AWS (S3, SQS, SNS, others) • Bean • Cache (EHCache) • CXF (JAX-WS, JAX-RS) • EJB • Drools • File • FTP/SFTP • Google App Engine • GMail • HTTP • IRC • jclouds • JDBC • Jetty • Twitter • MQTT • MyBatis • JPA • Spring Integration • Spring Web Services http://camel.apache.org/components.html To see list of all components!!
- 14. RED HAT | ADD NAME14 Java DSL public class OrderProcessorRouteBuilder extends RouteBuilder { @Override public void configure() throws Exception { from(“activemq:orders”) .choice() .when(header(“customer-rating”).isEqualTo(“gold”)) .to(“ibmmq:topic:specialCustomer”) .otherwise() .to(“ftp://user@host/orders/regularCustomers”) .end() .log(“received new order ${body.orderId}”) .to(“ibatis:storeOrder?statementType=Insert”); } }
- 15. RED HAT | ADD NAME15 Spring XML DSL <route id=“processOrders”> <from uri=“activemq:orders”/> <choice> <when> <simple>${header.customer-rating} == ‘gold’</simple> <to uri=“ibmmq:topic:specialCustomer”> </when> <otherwise> <to uri=“ftp://user@host/orders/regularCustomers” /> </otherwise> </choice> <log message=“received new order ${body.orderId}”/> <to uri=“ibatis:storeOrder?statementType=Insert”/> </route>
- 16. RED HAT | ADD NAME16 • Batch file transfers • Shared Database • RPC • Messaging Integration Options
- 17. RED HAT | ADD NAME17 • Asynchronous architectures • Reliable message passing • Loose coupling • Heterogeneous integration • Fault tolerant • Scalable • Real-time data Why messaging?
- 18. RED HAT | ADD NAME18 • The most widely used open-source messaging broker • Highly configurable • Friendly license (no license fees!) • Vibrant community (TLP) • Backbone of top enterprises in retail, e-retail, financial services, shipping, many others! Apache ActiveMQ
- 19. RED HAT | ADD NAME19 • High performance • High availability • Light-weight • Multi-protocol (AMQP, MQTT, STOMP) • Multi-transport (TCP,SSL,WS,VM,HTTP) • JMS compliant • Supported in production by Red Hat! ActiveMQ Features
- 20. RED HAT | ADD NAME20 Network of Master/Slave
- 21. RED HAT | ADD NAME21 High-performance, real-time systems Head Office STORE STORE outlet shop 24 houra STORE shop Broker Clusters • Clustering, Network of Brokers • Client-aware failover • Master/Slave HA • Fabric
- 22. RED HAT | ADD NAME22 Ingestion for BigData Architecture Broker Cluster Broker Cluster Web Servers Web Servers Web Servers Web Servers Camel HTTP Log Reader Camel HTTP Log Reader Camel HTTP Log Reader Camel HTTP Log Reader ESB ESB Camel HBase/HDFS Camel Hbase/HDFS HDFS
- 23. RED HAT | ADD NAME23 Integration Everywhere – Internet of Things Connecting Things • mobile devices • meters • industrial controls • smart buildings • asset tracking • traffic control • monitors • sensors • actuators Broker Clusters Arrival Airport 1
- 24. RED HAT | ADD NAME24 JBoss Fuse Integrate Everything!
- 25. RED HAT | ADD NAME25 More info on JBoss Fuse… https://www.redhat.com/products/jbossenterprisemiddleware/fuse/ http://www.jboss.org/products/fuse
- 26. Demo
- 27. Management
- 28. RED HAT | ADD NAME28
- 29. RED HAT | ADD NAME29 Current issues with deployments • Installation • SSH, download, unpack, install, permissions, ENV var • Configuration • Container, individual apps/services, brokers, security • Upgrading • Install, configure, rollback • Introspection • Big picture statistics (JVM/OS memory usage, CPU) • JMX (jconsole, visualVM)
- 30. RED HAT | ADD NAME30 Clients aware of Topology • Brokers • failover:(tcp://host1:port1,tcp://host2:port2) • Camel endpoints • from(“jetty:http://22.33.44.55:8080/endpoint”) • to(“http4://11.22.33.44:9000/endpoint”) • Web service endpoints • Access a specific endpoint: http://22.33.44.55:9091/endpoint
- 31. RED HAT | ADD NAME31 Current best practices • Use templates for configuration w/ template engine • Puppet/Chef and/or Capistrano/Ansible • Store configuration (templates + values) in SCM • Separate configuration from binary deployments • Verifiable build and release process
- 32. RED HAT | ADD NAME32 • Simplifies deployments • Provides management tools for centralized configuration • Visualize your middleware with HawtIO • Polycontainer • Blurs the line of PaaS http://fabric8.io
- 33. RED HAT | ADD NAME33 • Provides cluster capabilities, coordination • Service discovery, load balancing, failover • Deploy to cloud (IaaS, PaaS) • Supported as JBoss Fuse (managed) • fabric8 1.0 is in Fuse 6.1 • 1.1 about to be released • RC1 released 6/10 http://fabric8.io
- 34. RED HAT | ADD NAME34 fabric8 1.1 release • Java Container • Tomcat, TomEE, Jetty • Spring Boot • fabric:watch * with various containers • Profile import/export • fabric8 maven plugin enhancements
- 35. RED HAT | ADD NAME35 Architecture Clustered Registry Agent Agent Zookeeper Agent Zookeeper Agent Zookeeper Version 1.0 Profile CXFProfile Camel Profile Default Features Configuration Registry Content containers that form an “ensemble” Pulls profile data Registers / Listens for changes
- 36. RED HAT | ADD NAME36 Core concepts • Fabric registry • Holds all configuration data • Runtime registry for looking up distributed services • Profile • Describes the container set up • Features, Bundles, ConfigAdmin PIDs, system properties • Hierarchical structure • Container versioning • Agent • Runs on each container • Communicates with registry to make sure container provisioned correctly
- 37. RED HAT | ADD NAME37 How’s fabric8 different than Puppet/Chef? • Middleware centric • Container agnostic • Deep knowledge about the running processes • Consistent configuration • Visualizations • Versioning built in, upgrades, rollbacks, selective upgrade, etc • Use puppet/chef to provision your machines, use fabric8 to provision and manage your middleware/ apps
- 38. RED HAT | ADD NAME38 Fuse Management Console
- 39. RED HAT | ADD NAME39 HawtIO http://hawt.io
- 40. RED HAT | ADD NAME40 HawtIO http://hawt.io
- 41. RED HAT | ADD NAME41 FuFuse Management Console
- 42. Demo
- 44. RED HAT | ADD NAME44 Continuous Delivery • Builds on continuous integration • Establish a concrete pipeline to production • Build/Test/Release often! • Bottlenecks? • Involves Dev and Ops to be successful • Every build is a “release candidate”
- 45. RED HAT | ADD NAME45 Automate everything! • Developers • Unit tests • Integration tests • Builds • Deployments in dev • Operations • VMs • Provisioning software • Deployments in QA/UAT/PROD
- 46. RED HAT | ADD NAME46 Tools for a CD pipeline • Puppet/Chef to provision VMs • Git for SCM • Gerrit/Gitlab for code reviews • Maven • Jenkins + plugins • and of course… Fabric8! • What’s this Docker thingy?
- 47. RED HAT | ADD NAME47 Fabric8 maven plugin • fabric8:deploy • fabric8:zip • fabric8:aggregate-zip • fabric8:branch • fabric8:script (for karaf only) • http://fabric8.io/gitbook/mavenPlugin.html
- 48. RED HAT | ADD NAME48 Sample flow • Check your code in • Gerrit for code reviews • Jenkins for build + CD pipeline • Use fabric8:zip to deploy profiles to Maven repo • Use fabric8:branch to automate deploying multiple profiles to QA/UAT/PROD • Can use profile-import to manually import zips • Build the binary once!
- 49. Demo
- 50. Containers
- 51. RED HAT | ADD NAME51 Docker • http://docker.io • Open source • Lightweight VEs • Linux containers (LXC) • Portable packaging • Versioned • Repositories
- 52. RED HAT | ADD NAME52 How different than VMs?
- 53. RED HAT | ADD NAME53 Fabric8 Docker support • Docker images • Build docker containers for your java apps • Flat classpath • Microservices
- 54. Demo
- 55. OpenShift PaaS
- 56. RED HAT | ADD NAME56 What is OpenShift? Red Hat’s free platform as a service for applications in the cloud.
- 57. RED HAT | ADD NAME57 What’s supported?
- 58. RED HAT | ADD NAME58 Flavors origin Public Cloud Service On- premise or Private Cloud Software Open Source Project
- 59. RED HAT | ADD NAME59 Terminology l Broker – Management host, orchestration of Nodes l Node – Compute host containing Gears l Gear – Allocation of fixed memory, compute, and storage resources for running applications l Cartridge – A technology/framework (PHP, Perl, Java/ JEE, Ruby, Python, MySQL, etc.) to build applications l Application – Instantiation of a Cartridge l Client Tools – CLI, Eclipse Plugin, Web Console, Java API, REST API
- 60. RED HAT | ADD NAME60 xPaaS/iPaaS l xPaaS - Cartridges for Entire JBoss & Fuse Portfolio - EAP and EWS Enterprise Cartridges Today - Several Community Cartridges Available Today l iPaaS - Integration PaaS - Fuse/Fabric Cartridge
- 61. RED HAT | ADD NAME61 More Info http://fabric8.io http://hawt.io http://docker.io http://jboss.org/products/fuse http://activemq.apache.org http://camel.apache.org
- 62. RED HAT | ADD NAME62 Questions? http://christianposta.com/blog @christianposta christian@redhat.com