Hadoopを業務で使ってみました

•Télécharger en tant que KEY, PDF•

4 j'aime•2,196 vues

Tatsuya Sasaki

テックライフLT #tllt で使ったスライドです

Technologie Formation

Hadoop

• Hadoop Streaming
• Ruby

• Amazon EC2 Hadoop
• 50

Hadoop cat

`hadoop dfs -cat s3://xxxx/user/root/in/hoge`
HDFS

• Hadoop Streaming HDFS
(Hadoop
cat )

• 7000 30
Hadoop

Contenu connexe

Tendances

Qubole Overview at the Fifth Elephant Conference

Joydeep Sen Sarma

Cassandra/Hadoop Integration

Jeremy Hanna

Cloud Optimized Big Data

Joydeep Sen Sarma

PySpark Cassandra - Amsterdam Spark Meetup

Frens Jan Rumph

Hadoop big data online training

Magnific Trainings

Hadoop 101 - Big Data Technology

Firman Gautama

This presentation focuses on how Flickr recently brought scalable computer vision and deep learning to Flickr's multi-billion collection of photos using Apache Hadoop and Storm. Video of the presentation is available here: https://www.youtube.com/watch?v=OrhAbZGkW8k From the May 14, 2014 San Francisco Hadoop User Group meeting. For more information on the SFHUG see http://www.meetup.com/hadoopsf/ If you'd like to work on interesting challenges like this at Flickr in San Francisco, please see http://www.flickr.com/jobs

Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)

Yahoo Developer Network

Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340

Big Data Joe™ Rossi

Introduction to the Hadoop Ecosystem (codemotion Edition)

Uwe Printz

Introduction to Apache Hivemall v0.5.2 and v0.6

Makoto Yui

Productive data engineer

Rafał Wojdyła

Hive vs Pig for HadoopSourceCodeReading

Mitsuharu Hamba

Hadoop introduction

shubham kuwar

Drill at the Chug 9-19-12

Ted Dunning

Hadoop basics

Antonio Silveira

Cassandra + Spark (You’ve got the lighter, let’s start a fire)

Robert Stupp

Hadoop training

TIB Academy

This is Apache Pig & Pig Latin Session. We provide training on Big Data & Hadoop,Hadoop Admin ,MongoDB,Data Analytics with R, Python..etc Our Big Data & Hadoop course consists of Introduction of Hadoop and Big Data,HDFS architecture ,MapReduce ,YARN ,PIG Latin ,Hive,HBase,Mahout,Zookeeper,Oozie,Flume,Spark,Nosql with quizzes and assignments. To watch the video or know more about the course, please visit http://www.knowbigdata.com/page/big-data-and-hadoop-online-instructor-led-training

Introduction to pig & pig latin

knowbigdata

Map reduce and hadoop at mylife

responseteam

Tendances (19)

Qubole Overview at the Fifth Elephant Conference

Cassandra/Hadoop Integration

Cloud Optimized Big Data

PySpark Cassandra - Amsterdam Spark Meetup

Hadoop big data online training

Hadoop 101 - Big Data Technology

Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)

Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340

Introduction to the Hadoop Ecosystem (codemotion Edition)

Introduction to Apache Hivemall v0.5.2 and v0.6

Productive data engineer

Hive vs Pig for HadoopSourceCodeReading

Hadoop introduction

Drill at the Chug 9-19-12

Hadoop basics

Cassandra + Spark (You’ve got the lighter, let’s start a fire)

Hadoop training

Introduction to pig & pig latin

Map reduce and hadoop at mylife

Plus de Tatsuya Sasaki

からあげエンジニアについて

クックパッドでのemr利用事例

からあげとビーチと私

メタプログラミングでDSLを書こう

NoSQLデータベースが登場した背景と特徴

Hadoopをemr経由で利用する方法

COOKPADでのHadoop利用

Hadoop導入事例 in クックパッド

Hadoopを業務で使ってみた

YUI

Plus de Tatsuya Sasaki (10)

からあげエンジニアについて

クックパッドでのemr利用事例

からあげとビーチと私

メタプログラミングでDSLを書こう

NoSQLデータベースが登場した背景と特徴

Hadoopをemr経由で利用する方法

COOKPADでのHadoop利用

Hadoop導入事例 in クックパッド

Hadoopを業務で使ってみた

YUI

Dernier

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

ICT role in 21st century education and its challenges

rafiqahmad00786416

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

Scalable LLM APIs for AI and Generative AI Application Development Ettikan Karuppiah, Director/Technologist - NVIDIA Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

apidays

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

DBX First Quarter 2024 Investor Presentation

Dropbox

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

Dernier (20)

Artificial Intelligence Chap.5 : Uncertainty

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

ICT role in 21st century education and its challenges

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Automating Google Workspace (GWS) & more with Apps Script

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

GenAI Risks & Security Meetup 01052024.pdf

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

MS Copilot expands with MS Graph connectors

DBX First Quarter 2024 Investor Presentation

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Powerful Google developer tools for immediate impact! (2023-24 C)

Boost Fertility New Invention Ups Success Rates.pdf

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

AWS Community Day CPH - Three problems of Terraform

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Data Cloud, More than a CDP by Matt Robison