LCA14: LCA14-208: Introduction to CI @ Linaro 3 of 3

•

0 likes•673 views

Resource: LCA14 Name: LCA14-208: Introduction to CI @ Linaro 3 of 3 Date: 04-03-2014 Speaker: F.Boudra, T.Baker, M.Wasilewski Video: https://www.youtube.com/watch?v=mhD-QNZTguY

Technology

Tue-4-Mar, 12:10pm, F.Boudra, T.Baker, M.Wasilewski
LCA14-208: Intro to CI @ Linaro 3 of 3

Hour 1
● QA Services will introduce you to existing Linaro Test Plans
● Builds and Baselines will provide an overview to our build system, how
to create, manage and close out a build and how to submit the build
artifacts to LAVA for a test on lab hardware.
Hour 2
● LAVA will describe the process of adding new test capabilities (New
Platforms and/or New external test equipment)
● QA Services will overview how they use LAVA for tests
Hour 3
● LAVA will show you new features to improve test result filtering and
Visualization in LAVA
● QA Services will show you how Linaro rolls all the Build results, Test
Results (Manual / LAVA) into our test reports
Intro to CI @ Linaro

• LAVA is an automation framework
• i.e. scheduling jobs and interfacing with hardware
• it provides a basic level of visualization
• LAVA results can be easily published to external
systems for performing advanced analysis
• 1. QA Test Reports
• 2. Publishing to downstream data stores
• 3. Post processing by advanced statistical tools, R, etc...
Getting the most out of LAVA Results

• LAVA Test Shell Results
• Pass / Fail / Measurement
• Helper functions
• Regular Expression Parsing
• lava-test-attach
• limits
• LAVA Log files
• LAVA Results API
• job_submit
• job_status
• job_get
• General Publishing capabilities
• No rules
• Simply a step at the completion of your regular tests to copy files to
other systems
• Scripts that pass files - HTTP, Custom Servers, SCP, NFS, etc...
Recording Data During LAVA jobs

• Submit Job
• Live Results
• Poll the results
• Filter LAVA Jobs
• Visualize LAVA results
• Add comments on an observation
Demo

• Automated results
• Calxeda highbank
• Calxeda midway
• Arndale-Octa (coming soon)
• FVP models (including Foundation model)
• Manual results
• Ubuntu
• Android
• Publishing test results
• mailing lists
• release page
• Reporting defects
• Launchpad
• mailing lists
• Jira
QA Test Reports

• Combining manual and automated test results
• Detecting scheduled but not executed test suites from
LAVA
• Tagging weekly/monthly test results (as opposed to daily
tests)
• Better presentation than Google spreadsheets
New QA reporting tools (coming soon)

More about Linaro Connect: http://connect.linaro.org
More about Linaro: http://www.linaro.org/about/
More about Linaro engineering: http://www.linaro.org/engineering/
Linaro members: www.linaro.org/members

More from Linaro

Speaker: Pavel Shamis Company: Arm Speaker Bio: "Pavel is a Principal Research Engineer at ARM with over 16 years of experience in development HPC solutions. His work is focused on co-design software and hardware building blocks for high-performance interconnect technologies, development communication middleware and novel programming models. Prior to joining ARM, he spent five years at Oak Ridge National Laboratory (ORNL) as a research scientist at Computer Science and Math Division (CSMD). In this role, Pavel was responsible for research and development multiple projects in high-performance communication domain including: Collective Communication Offload (CORE-Direct & Cheetah), OpenSHMEM, and OpenUCX. Before joining ORNL, Pavel spent ten years at Mellanox Technologies, where he led Mellanox HPC team and was one of the key driver in enablement Mellanox HPC software stack, including OFA software stack, OpenMPI, MVAPICH, OpenSHMEM, and other. Pavel is a recipient of prestigious R&D100 award for his contribution in development of the CORE-Direct collective offload technology and he published in excess of 20 research papers. " Talk Title: HPC network stack on ARM Talk Abstract: Applications, programming languages, and libraries that leverage sophisticated network hardware capabilities have a natural advantage when used in today¹s and tomorrow's high-performance and data center computer environments. Modern RDMA based network interconnects provides incredibly rich functionality (RDMA, Atomics, OS-bypass, etc.) that enable low-latency and high-bandwidth communication services. The functionality is supported by a variety of interconnect technologies such as InfiniBand, RoCE, iWARP, Intel OPA, Cray¹s Aries/Gemini, and others. Over the last decade, the HPC community has developed variety user/kernel level protocols and libraries that enable a variety of high-performance applications over RDMA interconnects including MPI, SHMEM, UPC, etc. With the emerging availability HPC solutions based on ARM CPU architecture it is important to understand how ARM integrates with the RDMA hardware and HPC network software stack. In this talk, we will overview ARM architecture and system software stack, including MPI runtimes, OpenSHMEM, and OpenUCX.

HPC network stack on ARM - Linaro HPC Workshop 2018

Linaro

Speaker: Jay Kruemcke Speaker Company: SUSE Bio: "Jay is responsible for the SUSE Linux server products for High Performance Computing, 64-bit ARM systems, and SUSE Linux for IBM Power servers. Jay has built an extensive career in product management including using social media for client collaboration, product positioning, driving future product directions, and evangelizing the capabilities and future directions for dozens of enterprise products. " Talk Title: It just keeps getting better - SUSE enablement for Arm Talk Abstract: SUSE has been delivering commercial Linux support for Arm based servers since 2016. Initially the focus was on high end servers for HPC and Ceph based software defined storage. But we have enabled a number of other Arm SoCs and are even supporting the Raspberry Pi. This session will cover the SUSE products that are available for the Arm platform and view to the future.

It just keeps getting better - SUSE enablement for Arm - Linaro HPC Workshop ...

Linaro

Speakers: Gilad Shainer and Scot Schultz Company: Mellanox Technologies Talk Title: Intelligent Interconnect Architecture to Enable Next Generation HPC Talk Abstract: The latest revolution in HPC interconnect architecture is the development of In-Network Computing, a technology that enables handling and accelerating application workloads at the network level. By placing data-related algorithms on an intelligent network, we can overcome the new performance bottlenecks and improve the data center and applications performance. The combination of In-Network Computing and ARM based processors offer a rich set of capabilities and opportunities to build the next generation of HPC platforms. Gilad Shainer Bio: Gilad Shainer has served as Mellanox's vice president of marketing since March 2013. Previously, Mr. Shainer was Mellanox's vice president of marketing development from March 2012 to March 2013. Mr. Shainer joined Mellanox in 2001 as a design engineer and later served in senior marketing management roles between July 2005 and February 2012. Mr. Shainer holds several patents in the field of high-speed networking and contributed to the PCI-SIG PCI-X and PCIe specifications. Gilad Shainer holds a MSc degree (2001, Cum Laude) and a BSc degree (1998, Cum Laude) in Electrical Engineering from the Technion Institute of Technology in Israel. Scot Schultz Bio: Scot Schultz is a HPC technology specialist with broad knowledge in operating systems, high speed interconnects and processor technologies. Joining the Mellanox team in 2013, Schultz is 30-year veteran of the computing industry. Prior to joining Mellanox, he spent the past 17 years at AMD in various engineering and leadership roles in the area of high performance computing. Scot has also been instrumental with the growth and development of various industry organizations including the Open Fabrics Alliance, and continues to serve as a founding board-member of the OpenPOWER Foundation and Director of Educational Outreach and founding member of the HPC-AI Advisory Council.

Intelligent Interconnect Architecture to Enable Next Generation HPC - Linaro ...

Linaro

Yutaka Ishikawa - Post-K and Arm HPC Ecosystem - Linaro Arm HPC Workshop Santa Clara 2018 Bio: "Yutaka Ishikawa is the project leader of developing the post K supercomputer. From 1987 to 2001, he was a member of AIST (former Electrotechnical Laboratory), METI. From 1993 to 2001, he was the chief of Parallel and Distributed System Software Laboratory at Real World Computing Partnership. He led development of cluster system software called SCore, which was used in several large PC cluster systems around 2004. From 2002 to 2014, he was a professor at the University Tokyo. He led a project to design a commodity-based supercomputer called T2K open supercomputer. As a result, three universities, Tsukuba, Tokyo, and Kyoto, obtained each supercomputer based on the specification in 2008. He was also involved with the design of the Oakleaf-PACS, the successor of T2K supercomputer in both Tsukuba and Tokyo, whose peak performance is 25PF." Session Title: Post-K and Arm HPC Ecosystem Session Description: "Post-K, a flagship supercomputer in Japan, is being developed by Riken and Fujitsu. It will be the first supercomputer with Armv8-A+SVE. This talk will give an overview of Post-K and how RIKEN and Fujitsu are currently working on software stack for an Arm architecture."

Yutaka Ishikawa - Post-K and Arm HPC Ecosystem - Linaro Arm HPC Workshop Sant...

Linaro

Event: Arm Architecture HPC Workshop by Linaro and HiSilicon Location: Santa Clara, CA Speaker: Andrew J Younge Talk Title: Vanguard Astra - Petascale Arm Platform for U.S. DOE/ASC Supercomputing Talk Desc: The Vanguard program looks to expand the potential technology choices for leadership-class High Performance Computing (HPC) platforms, not only for the National Nuclear Security Administration (NNSA) but for the Department of Energy (DOE) and wider HPC community. Specifically, there is a need to expand the supercomputing ecosystem by investing and developing emerging, yet-to-be-proven technologies and address both hardware and software challenges together, as well as to prove-out the viability of such novel platforms for production HPC workloads. The first deployment of the Vanguard program will be Astra, a prototype Petascale Arm supercomputer to be sited at Sandia National Laboratories during 2018. This talk will focus on the arthictecural details of Astra and the significant investments being made towards the maturing the Arm software ecosystem. Furthermore, we will share initial performance results based on our pre-general availability testbed system and outline several planned research activities for the machine. Bio: Andrew Younge is a R&D Computer Scientist at Sandia National Laboratories with the Scalable System Software group. His research interests include Cloud Computing, Virtualization, Distributed Systems, and energy efficient computing. Andrew has a Ph.D in Computer Science from Indiana University, where he was the Persistent Systems fellow and a member of the FutureGrid project, an NSF-funded experimental cyberinfrastructure test-bed. Over the years, Andrew has held visiting positions at the MITRE Corporation, the University of Southern California / Information Sciences Institute, and the University of Maryland, College Park. He received his Bachelors and Masters of Science from the Computer Science Department at Rochester Institute of Technology (RIT) in 2008 and 2010, respectively.

Andrew J Younge - Vanguard Astra - Petascale Arm Platform for U.S. DOE/ASC Su...

Linaro

HKG18-501 - EAS on Common Kernel 4.14 and getting (much) closer to mainline

Linaro

HKG18-100K1 - George Grey: Opening Keynote

Linaro

HKG18-318 - OpenAMP Workshop

Linaro

HKG18-501 - EAS on Common Kernel 4.14 and getting (much) closer to mainline

Linaro

HKG18-315 - Why the ecosystem is a wonderful thing, warts and all

Linaro

HKG18- 115 - Partitioning ARM Systems with the Jailhouse Hypervisor

Linaro

HKG18-TR08 - Upstreaming SVE in QEMU

Linaro

HKG18-113- Secure Data Path work with i.MX8M

Linaro

HKG18-120 - Devicetree Schema Documentation and Validation

Linaro

HKG18-223 - Trusted FirmwareM: Trusted boot

Linaro

HKG18-500K1 - Keynote: Dileep Bhandarkar - Emerging Computing Trends in the D...

Linaro

HKG18-317 - Arm Server Ready Program

Linaro

HKG18-312 - CMSIS-NN

Linaro

HKG18-301 - Dramatically Accelerate 96Board Software via an FPGA with Integra...

Linaro

HKG18-300K2 - Keynote: Tomas Evensen - All Programmable SoCs? – Platforms to ...

Linaro

More from Linaro (20)

HPC network stack on ARM - Linaro HPC Workshop 2018

It just keeps getting better - SUSE enablement for Arm - Linaro HPC Workshop ...

Intelligent Interconnect Architecture to Enable Next Generation HPC - Linaro ...

Yutaka Ishikawa - Post-K and Arm HPC Ecosystem - Linaro Arm HPC Workshop Sant...

Andrew J Younge - Vanguard Astra - Petascale Arm Platform for U.S. DOE/ASC Su...

HKG18-501 - EAS on Common Kernel 4.14 and getting (much) closer to mainline

HKG18-100K1 - George Grey: Opening Keynote

HKG18-318 - OpenAMP Workshop

HKG18-501 - EAS on Common Kernel 4.14 and getting (much) closer to mainline

HKG18-315 - Why the ecosystem is a wonderful thing, warts and all

HKG18- 115 - Partitioning ARM Systems with the Jailhouse Hypervisor

HKG18-TR08 - Upstreaming SVE in QEMU

HKG18-113- Secure Data Path work with i.MX8M

HKG18-120 - Devicetree Schema Documentation and Validation

HKG18-223 - Trusted FirmwareM: Trusted boot

HKG18-500K1 - Keynote: Dileep Bhandarkar - Emerging Computing Trends in the D...

HKG18-317 - Arm Server Ready Program

HKG18-312 - CMSIS-NN

HKG18-301 - Dramatically Accelerate 96Board Software via an FPGA with Integra...

HKG18-300K2 - Keynote: Tomas Evensen - All Programmable SoCs? – Platforms to ...

Recently uploaded

Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf

FIDO Alliance

Oauth 2.0 Introduction and Flows with MuleSoft

shyamraj55

Discover the top Symfony development companies that excel in creating robust and scalable web applications. Our latest blog highlights the best firms specializing in Symfony, known for their expertise in delivering high-performance solutions. Whether you’re looking to start a new project or enhance an existing one, these companies offer the skills and experience needed to bring your vision to life. Read more to find your perfect Symfony development partner.

Top 10 Symfony Development Companies 2024

TopCSSGallery

Screen flow is a powerful automation tool that is commonly designed for internal and external users. However, what about the guest users? We will dive into various methods of launching screen flows and understand how to make them publicly accessible, extending their usability to a broader audience. The presentation will also cover the implementation of security layers and highlight best practices for a smooth and protected user experience. Discover the potential of screen flows beyond conventional use and learn how to leverage them effectively.

Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade

CzechDreamin

Unlock the mysteries of successful Salesforce interviews in this insightful session hosted by Hugo Rosario (Salesforce Customer), a seasoned hiring manager that leads the Salesforce Department of multinational company with over 100 interviews under their belt. Step into the manager's chair and gain exclusive behind-the-scenes insights into what makes a Salesforce consultant stand out during the interview process. From deciphering the unspoken cues to mastering key strategies, we'll explore the intricacies of the interview process and provide practical tips for consultants looking to not only pass interviews but also thrive in their roles. Whether you're a seasoned professional or just starting your Salesforce journey, this session is your backstage pass to the secrets that hiring managers wish you knew.

Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...

CzechDreamin

Already know how to write a basic SOQL query? Great! But what about an *aggregate* SOQL query? You know, the kind that uses aggregate functions like COUNT & MAX along with GROUP BY and HAVING clauses? No? Well, get ready to learn how to slice & dice your org’s data right inside your own dev console. From finding duplicate records to prototyping summary & matrix reports, learn the ins and outs of aggregate queries during this fast-paced but admin-friendly session on advanced SOQL concepts.

SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...

CzechDreamin

IoT Analytics Company Presentation May 2024

IoTAnalytics

IESVE for Early Stage Design and Planning

IES VE

Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf

FIDO Alliance

The Metaverse: Are We There Yet?

Mark Billinghurst

WSO2CONMay2024OpenSourceConferenceDebrief.pptx

Jennifer Lim

Explore the core of Salesforce success in 'Salesforce Adoption – Metrics, Methods, and Motivation.' We will discuss essential metrics, effective methods to drive adoption, and the driving force behind user engagement and explore strategies for onboarding, training, and continuous support that empower users to navigate the platform seamlessly. By leveraging these tools, you can effectively measure adoption against your company’s goals and create an environment where users not only adopt Salesforce but actively contribute to its ongoing success.

Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom

CzechDreamin

Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...

FIDO Alliance

PLAI - Acceleration Program for Generative A.I. Startups

Stefano

This presentation dives into the practical applications of machine learning within Google's operations, providing a comprehensive overview of how to leverage AI technologies to solve real-world business challenges. Key Points Covered: - Introduction to Machine Learning at Google: Discussion on the role of ML and its evolution in enhancing Google's operational efficiency. - Experience Sharing: Insights into the team's long-term engagement with machine learning projects and the impacts on Google’s operational strategies. - Practical Applications: Real-world examples of ML applications within Google’s daily operations, providing a blueprint to adapt similar strategies. - Challenges and Solutions: Discussion on the challenges faced during the implementation of ML projects and the strategic solutions employed to overcome them. - Future of ML at Google: Insights into future trends in machine learning at Google and how they plan to continue integrating AI into their ecosystem.

Strategic AI Integration in Engineering Teams

UXDXConf

I'm excited to share my latest predictions on how AI, robotics, and other technological advancements will reshape industries in the coming years. The slides explore the exponential growth of computational power, the future of AI and robotics, and their profound impact on various sectors. Why this matters: The success of new products and investments hinges on precise timing and foresight into emerging categories. This deck equips founders, VCs, and industry leaders with insights to align future products with upcoming tech developments. These insights enhance the ability to forecast industry trends, improve market timing, and predict competitor actions. Highlights: ▪ Exponential Growth in Compute: How $1000 will soon buy the computational power of a human brain ▪ Scaling of AI Models: The journey towards beyond human-scale models and intelligent edge computing ▪ Transformative Technologies: From advanced robotics and brain interfaces to automated healthcare and beyond ▪ Future of Work: How automation will redefine jobs and economic structures by 2040 With so many predictions presented here, some will inevitably be wrong or mistimed, especially with potential external disruptions. For instance, a conflict in Taiwan could severely impact global semiconductor production, affecting compute costs and related advancements. Nonetheless, these slides are intended to guide intuition on future technological trends.

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl

Peter Udo Diehl

TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...

marcuskenyatta275

ScyllaDB has the potential to deliver impressive performance and scalability. The better you understand how it works, the more you can squeeze out of it. But before you squeeze, make sure you know what to monitor! Watch our experienced Postgres developer work through monitoring and performance strategies that help him understand what mistakes he’s made moving to NoSQL. And learn with him as our database performance expert offers friendly guidance on how to use monitoring and performance tuning to get his sample Rust application on the right track. This webinar focuses on using monitoring and performance tuning to discover and correct mistakes that commonly occur when developers move from SQL to NoSQL. For example: - Common issues getting up and running with the monitoring stack - Using the CQL optimizations dashboard - Common issues causing high latency in a node - Common issues causing replica imbalance - What a healthy system looks like in terms of memory - Key metrics to keep an eye on This isn’t “Death-by-Powerpoint.” We’ll walk through problems encountered while migrating a real application from Postgres to ScyllaDB – and try to fix them live as well.

Optimizing NoSQL Performance Through Observability

ScyllaDB

Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...

FIDO Alliance

How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf

FIDO Alliance

Recently uploaded (20)

Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf

Oauth 2.0 Introduction and Flows with MuleSoft

Top 10 Symfony Development Companies 2024

Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade

Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...

SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...

IoT Analytics Company Presentation May 2024

IESVE for Early Stage Design and Planning

Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf

The Metaverse: Are We There Yet?

WSO2CONMay2024OpenSourceConferenceDebrief.pptx

Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom

Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...

PLAI - Acceleration Program for Generative A.I. Startups

Strategic AI Integration in Engineering Teams

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl

TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...

Optimizing NoSQL Performance Through Observability

Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...

How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf

LCA14: LCA14-208: Introduction to CI @ Linaro 3 of 3

1. Tue-4-Mar, 12:10pm, F.Boudra, T.Baker, M.Wasilewski LCA14-208: Intro to CI @ Linaro 3 of 3

2. Hour 1 ● QA Services will introduce you to existing Linaro Test Plans ● Builds and Baselines will provide an overview to our build system, how to create, manage and close out a build and how to submit the build artifacts to LAVA for a test on lab hardware. Hour 2 ● LAVA will describe the process of adding new test capabilities (New Platforms and/or New external test equipment) ● QA Services will overview how they use LAVA for tests Hour 3 ● LAVA will show you new features to improve test result filtering and Visualization in LAVA ● QA Services will show you how Linaro rolls all the Build results, Test Results (Manual / LAVA) into our test reports Intro to CI @ Linaro

3. • LAVA is an automation framework • i.e. scheduling jobs and interfacing with hardware • it provides a basic level of visualization • LAVA results can be easily published to external systems for performing advanced analysis • 1. QA Test Reports • 2. Publishing to downstream data stores • 3. Post processing by advanced statistical tools, R, etc... Getting the most out of LAVA Results

4. • LAVA Test Shell Results • Pass / Fail / Measurement • Helper functions • Regular Expression Parsing • lava-test-attach • limits • LAVA Log files • LAVA Results API • job_submit • job_status • job_get • General Publishing capabilities • No rules • Simply a step at the completion of your regular tests to copy files to other systems • Scripts that pass files - HTTP, Custom Servers, SCP, NFS, etc... Recording Data During LAVA jobs

5. • Submit Job • Live Results • Poll the results • Filter LAVA Jobs • Visualize LAVA results • Add comments on an observation Demo

6. • Automated results • Calxeda highbank • Calxeda midway • Arndale-Octa (coming soon) • FVP models (including Foundation model) • Manual results • Ubuntu • Android • Publishing test results • mailing lists • release page • Reporting defects • Launchpad • mailing lists • Jira QA Test Reports

7. • Combining manual and automated test results • Detecting scheduled but not executed test suites from LAVA • Tagging weekly/monthly test results (as opposed to daily tests) • Better presentation than Google spreadsheets New QA reporting tools (coming soon)

8. More about Linaro Connect: http://connect.linaro.org More about Linaro: http://www.linaro.org/about/ More about Linaro engineering: http://www.linaro.org/engineering/ Linaro members: www.linaro.org/members

LCA14: LCA14-208: Introduction to CI @ Linaro 3 of 3

Recommended

Recommended

More Related Content

More from Linaro

More from Linaro (20)

Recently uploaded

Recently uploaded (20)

LCA14: LCA14-208: Introduction to CI @ Linaro 3 of 3