SlideShare une entreprise Scribd logo
1  sur  18
Télécharger pour lire hors ligne
Smart data,
Lily                                                                     at scale
                                                                         madE easy




 from content storage
 to scaling smart data


  IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org
the pain

                                                   data


                            need for
                           distributed
                           processing
                                                            moore




     IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   2
the pain

» growth of data sets
» smart businesses need
  to apply analytics to                                            Smart data,
  activities
                                                                   at scale
» doing business online
  means real-time
                                                                   madE easy
» talent shortage


        IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   3
LILY


 The Real-time Platform built for the Age of Data.

 We manage, track and measure your data and users,
 and do the mat(c)hmaking in-between:
 » provide you with business intelligence and analytics
 » harvest user profiles and learn their interests
 » dynamically engage your users using quality recommendations



        IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   4
where would you use lily?
» large collections of data                           » large groups of users
  » content repositories                                 » e-commerce / retail
  » library catalogs                                     » news / media
  » (media) asset management
  » product catalogs
  » ‘live’ archives

                                                      » ... if you want to use big
                                                         data, but you need easy.
             IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   5
beyond content management

                                                  marketing
          broadcast




                                                   revenue

                                             product / service


    IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   6
beyond content management: data + analytics

                                              recommendations
         call to action



      personalised

                                                     revenue

                                               product / service
                                         audience data
      IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   7
LILY 2.0: smart data
                      SMARTER DATA                 data processing
                                  s
                          relation
                                                     recommendations
                                                     semantic augmentation
                                                     Analytics




                                          usage
                                         metrics              domain
                                                            knowledge
                                                              patterns
                                                              rules
                                                              keywords
                                                              lists
                                                              ...




      IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   8
roadmap
» now: highly-scalable data repository: store, index and search
» next: with real-time usage stats gathering and analytics
» later: and built-in context- and user-sensitive
 recommendations

» built on top of Google BigTable / HBase / Solr
  » identical, robust technology in use at Facebook, Twitter,
    StumbleUpon, Yahoo!
  » scales widely over distributed (cloud) infrastructure

          IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   9
Lily Architecture
(deployment)




           IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   10
status june 2011

» Lily 1.0.1 released - developing since Q4/09
» some customers - DIY retail / media / news
 » e-commerce platform project
 » Lily as the data (integration) tier
» first contrib: FrogPond (annotated Java <> Lily mapper)
 https://bitbucket.org/calmera/frogpond


         IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   11
Next up: usage stats
» sits in CRUD-path
» tracks users ops against
  records
                                                                              interactions
  » from both perspectives
                                                           record                                  user
  » arbitrary K/V properties: time,
    location, ...




                                                              rec
» automatically builds user



                                                               om
                                                                 me
                                                                    nd
                                                                    ati
                                                                       o
  profiles (as records)


                                                                         ns
                                                                               indexes




                                                                                              e
                                                                                             tim
  » tied to records ops
  » indexed access
  » time dimension: trending

            IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org                     12
from usage stats to recommendations ‘light’

               record                                                     user



» grouping of users based on
 » shared properties
 » shared record access
» grouping of records based on
 » shared properties
                                                                    {     connections


 » shared user operations                                            recommendations

        IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org       13
full-on recommendations

» look at real-time-capable Mahout algorithms
» pre-index or -calculate as much as possible
 » save as secondary indexes
 » present recommendations as part of record API
» allow user to contribute ‘domain knowledge’ to
 record processing pipeline
 » pattern detection, keywords, ontologies, ...



         IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   14
timeline


» Lily + usage stats                                                                 10/2011
» Lily + usage stats + light-weight analytics                                        12/2011
» Lily + recommendations ‘light’                                                      3/2012
» Lily 2.0 : full-on recommendations                                                  6/2012



         IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org             15
WHERE?



                  www.lilyproject.org




IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   16
lily enterprise


» adds tools:
 » yum/deb package repo
 » cluster deploy scripts
   (also EC2)
 » Admin UI
» + enterprise support



         IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org   17
Thank you !
                               for your attention
                               for your questions

                               » stevenn@outerthought.org

                               »           @stevenn

  IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org

Contenu connexe

En vedette

Change2Micro Medanco 13-11-2015
Change2Micro Medanco 13-11-2015Change2Micro Medanco 13-11-2015
Change2Micro Medanco 13-11-2015Sirris
 
Slc lab-partners
Slc lab-partnersSlc lab-partners
Slc lab-partnersSirris
 
Invisible but functional - anti-fog coatings
Invisible but functional - anti-fog coatingsInvisible but functional - anti-fog coatings
Invisible but functional - anti-fog coatingsSirris
 
Invisible but functional - ir coatings
Invisible but functional - ir coatingsInvisible but functional - ir coatings
Invisible but functional - ir coatingsSirris
 
Invisible but functional - uv-protecting coatings
Invisible but functional - uv-protecting coatingsInvisible but functional - uv-protecting coatings
Invisible but functional - uv-protecting coatingsSirris
 
Invisible but functional - protective coatings
Invisible but functional - protective coatingsInvisible but functional - protective coatings
Invisible but functional - protective coatingsSirris
 
Invisible but functional - antistatic coatings
Invisible but functional - antistatic coatingsInvisible but functional - antistatic coatings
Invisible but functional - antistatic coatingsSirris
 
Invisible but functional - water resistent coatings
Invisible but functional - water resistent coatingsInvisible but functional - water resistent coatings
Invisible but functional - water resistent coatingsSirris
 

En vedette (9)

Change2Micro Medanco 13-11-2015
Change2Micro Medanco 13-11-2015Change2Micro Medanco 13-11-2015
Change2Micro Medanco 13-11-2015
 
WE Partnerships
WE PartnershipsWE Partnerships
WE Partnerships
 
Slc lab-partners
Slc lab-partnersSlc lab-partners
Slc lab-partners
 
Invisible but functional - anti-fog coatings
Invisible but functional - anti-fog coatingsInvisible but functional - anti-fog coatings
Invisible but functional - anti-fog coatings
 
Invisible but functional - ir coatings
Invisible but functional - ir coatingsInvisible but functional - ir coatings
Invisible but functional - ir coatings
 
Invisible but functional - uv-protecting coatings
Invisible but functional - uv-protecting coatingsInvisible but functional - uv-protecting coatings
Invisible but functional - uv-protecting coatings
 
Invisible but functional - protective coatings
Invisible but functional - protective coatingsInvisible but functional - protective coatings
Invisible but functional - protective coatings
 
Invisible but functional - antistatic coatings
Invisible but functional - antistatic coatingsInvisible but functional - antistatic coatings
Invisible but functional - antistatic coatings
 
Invisible but functional - water resistent coatings
Invisible but functional - water resistent coatingsInvisible but functional - water resistent coatings
Invisible but functional - water resistent coatings
 

Similaire à Sirris innovate2011 - Lily, Smart Data at scale made easy, Steven Noels, Outertought

Outerthought / Lily Partnerships
Outerthought / Lily PartnershipsOuterthought / Lily Partnerships
Outerthought / Lily PartnershipsNGDATA
 
Hadoop World 2011: Lily: Smart Data at Scale, Made Easy
Hadoop World 2011: Lily: Smart Data at Scale, Made EasyHadoop World 2011: Lily: Smart Data at Scale, Made Easy
Hadoop World 2011: Lily: Smart Data at Scale, Made EasyCloudera, Inc.
 
Welcome to the Age of Data
Welcome to the Age of DataWelcome to the Age of Data
Welcome to the Age of DataNGDATA
 
Lily at HUG UK
Lily at HUG UKLily at HUG UK
Lily at HUG UKNGDATA
 
Lily for the Bay Area HBase UG - NYC edition
Lily for the Bay Area HBase UG - NYC editionLily for the Bay Area HBase UG - NYC edition
Lily for the Bay Area HBase UG - NYC editionNGDATA
 
NoSQL intro for YaJUG / NoSQL UG Luxembourg
NoSQL intro for YaJUG / NoSQL UG LuxembourgNoSQL intro for YaJUG / NoSQL UG Luxembourg
NoSQL intro for YaJUG / NoSQL UG LuxembourgNGDATA
 
NoSQL with Hadoop and HBase
NoSQL with Hadoop and HBaseNoSQL with Hadoop and HBase
NoSQL with Hadoop and HBaseNGDATA
 
KVIV / NoSQL : the new generation of database servers
KVIV / NoSQL : the new generation of database serversKVIV / NoSQL : the new generation of database servers
KVIV / NoSQL : the new generation of database serversNGDATA
 
Learning Lessons: Building a CMS on top of NoSQL technologies
Learning Lessons: Building a CMS on top of NoSQL technologiesLearning Lessons: Building a CMS on top of NoSQL technologies
Learning Lessons: Building a CMS on top of NoSQL technologiesNGDATA
 
N-O-SQL, new database technologies on the rise
N-O-SQL, new database technologies on the riseN-O-SQL, new database technologies on the rise
N-O-SQL, new database technologies on the riseNGDATA
 
Building a CMS on top of NoSQL (for ParisJUG)
Building a CMS on top of NoSQL (for ParisJUG)Building a CMS on top of NoSQL (for ParisJUG)
Building a CMS on top of NoSQL (for ParisJUG)NGDATA
 
Devoxx 2010 | LAB : ReST in Java
Devoxx 2010 | LAB : ReST in JavaDevoxx 2010 | LAB : ReST in Java
Devoxx 2010 | LAB : ReST in JavaNGDATA
 
Devoxx 2010 | Tools In Action : Kauri and Lily
Devoxx 2010 | Tools In Action : Kauri and LilyDevoxx 2010 | Tools In Action : Kauri and Lily
Devoxx 2010 | Tools In Action : Kauri and LilyNGDATA
 
Some Observations on Common Patterns in Information Technology
Some Observations on Common Patterns in Information TechnologySome Observations on Common Patterns in Information Technology
Some Observations on Common Patterns in Information TechnologyFranz-Josef Behr
 
Data Mining
Data MiningData Mining
Data Miningswami920
 
Borders of Decidability in Verification of Data-Centric Dynamic Systems
Borders of Decidability in Verification of Data-Centric Dynamic SystemsBorders of Decidability in Verification of Data-Centric Dynamic Systems
Borders of Decidability in Verification of Data-Centric Dynamic Systemsnet2-project
 
Data Mining: Future Trends and Applications
Data Mining: Future Trends and ApplicationsData Mining: Future Trends and Applications
Data Mining: Future Trends and ApplicationsIJMER
 
Evolution from EDA to Data Mesh: Data in Motion
Evolution from EDA to Data Mesh: Data in MotionEvolution from EDA to Data Mesh: Data in Motion
Evolution from EDA to Data Mesh: Data in Motionconfluent
 

Similaire à Sirris innovate2011 - Lily, Smart Data at scale made easy, Steven Noels, Outertought (20)

Outerthought / Lily Partnerships
Outerthought / Lily PartnershipsOuterthought / Lily Partnerships
Outerthought / Lily Partnerships
 
Hadoop World 2011: Lily: Smart Data at Scale, Made Easy
Hadoop World 2011: Lily: Smart Data at Scale, Made EasyHadoop World 2011: Lily: Smart Data at Scale, Made Easy
Hadoop World 2011: Lily: Smart Data at Scale, Made Easy
 
Welcome to the Age of Data
Welcome to the Age of DataWelcome to the Age of Data
Welcome to the Age of Data
 
Lily at HUG UK
Lily at HUG UKLily at HUG UK
Lily at HUG UK
 
Huguk lily
Huguk lilyHuguk lily
Huguk lily
 
Lily for the Bay Area HBase UG - NYC edition
Lily for the Bay Area HBase UG - NYC editionLily for the Bay Area HBase UG - NYC edition
Lily for the Bay Area HBase UG - NYC edition
 
NoSQL intro for YaJUG / NoSQL UG Luxembourg
NoSQL intro for YaJUG / NoSQL UG LuxembourgNoSQL intro for YaJUG / NoSQL UG Luxembourg
NoSQL intro for YaJUG / NoSQL UG Luxembourg
 
NoSQL with Hadoop and HBase
NoSQL with Hadoop and HBaseNoSQL with Hadoop and HBase
NoSQL with Hadoop and HBase
 
KVIV / NoSQL : the new generation of database servers
KVIV / NoSQL : the new generation of database serversKVIV / NoSQL : the new generation of database servers
KVIV / NoSQL : the new generation of database servers
 
Learning Lessons: Building a CMS on top of NoSQL technologies
Learning Lessons: Building a CMS on top of NoSQL technologiesLearning Lessons: Building a CMS on top of NoSQL technologies
Learning Lessons: Building a CMS on top of NoSQL technologies
 
N-O-SQL, new database technologies on the rise
N-O-SQL, new database technologies on the riseN-O-SQL, new database technologies on the rise
N-O-SQL, new database technologies on the rise
 
Building a CMS on top of NoSQL (for ParisJUG)
Building a CMS on top of NoSQL (for ParisJUG)Building a CMS on top of NoSQL (for ParisJUG)
Building a CMS on top of NoSQL (for ParisJUG)
 
Devoxx 2010 | LAB : ReST in Java
Devoxx 2010 | LAB : ReST in JavaDevoxx 2010 | LAB : ReST in Java
Devoxx 2010 | LAB : ReST in Java
 
Devoxx 2010 | Tools In Action : Kauri and Lily
Devoxx 2010 | Tools In Action : Kauri and LilyDevoxx 2010 | Tools In Action : Kauri and Lily
Devoxx 2010 | Tools In Action : Kauri and Lily
 
Some Observations on Common Patterns in Information Technology
Some Observations on Common Patterns in Information TechnologySome Observations on Common Patterns in Information Technology
Some Observations on Common Patterns in Information Technology
 
Data Mining
Data MiningData Mining
Data Mining
 
Borders of Decidability in Verification of Data-Centric Dynamic Systems
Borders of Decidability in Verification of Data-Centric Dynamic SystemsBorders of Decidability in Verification of Data-Centric Dynamic Systems
Borders of Decidability in Verification of Data-Centric Dynamic Systems
 
Data Mining: Future Trends and Applications
Data Mining: Future Trends and ApplicationsData Mining: Future Trends and Applications
Data Mining: Future Trends and Applications
 
Evolution from EDA to Data Mesh: Data in Motion
Evolution from EDA to Data Mesh: Data in MotionEvolution from EDA to Data Mesh: Data in Motion
Evolution from EDA to Data Mesh: Data in Motion
 
Cloud based Web Intelligence
Cloud based Web IntelligenceCloud based Web Intelligence
Cloud based Web Intelligence
 

Plus de Sirris

Presentation - webinar embedded machine learning
Presentation - webinar embedded machine learningPresentation - webinar embedded machine learning
Presentation - webinar embedded machine learningSirris
 
2 - Pattyn - Smart Products Webinar 03-02-2023.
2 - Pattyn - Smart Products Webinar 03-02-2023.2 - Pattyn - Smart Products Webinar 03-02-2023.
2 - Pattyn - Smart Products Webinar 03-02-2023.Sirris
 
2021 01-27 - webinar - Corrosie van 3D geprinte onderdelen
2021 01-27 - webinar - Corrosie van 3D geprinte onderdelen2021 01-27 - webinar - Corrosie van 3D geprinte onderdelen
2021 01-27 - webinar - Corrosie van 3D geprinte onderdelenSirris
 
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
2021/0/15 - Solarwinds supply chain attack: why we should take it sereouslySirris
 
20200923 inside metal am webinar_laborelec
20200923 inside metal am webinar_laborelec20200923 inside metal am webinar_laborelec
20200923 inside metal am webinar_laborelecSirris
 
20200923 inside metal am webinar sirris-crm
20200923 inside metal am webinar sirris-crm20200923 inside metal am webinar sirris-crm
20200923 inside metal am webinar sirris-crmSirris
 
Challenges and solutions for improved durability of materials - Opin summary ...
Challenges and solutions for improved durability of materials - Opin summary ...Challenges and solutions for improved durability of materials - Opin summary ...
Challenges and solutions for improved durability of materials - Opin summary ...Sirris
 
Challenges and solutions for improved durability of materials - Hybrid joints...
Challenges and solutions for improved durability of materials - Hybrid joints...Challenges and solutions for improved durability of materials - Hybrid joints...
Challenges and solutions for improved durability of materials - Hybrid joints...Sirris
 
Challenges and solutions for improved durability of materials - Corrosion mon...
Challenges and solutions for improved durability of materials - Corrosion mon...Challenges and solutions for improved durability of materials - Corrosion mon...
Challenges and solutions for improved durability of materials - Corrosion mon...Sirris
 
Challenges and solutions for improved durability of materials - Concrete in m...
Challenges and solutions for improved durability of materials - Concrete in m...Challenges and solutions for improved durability of materials - Concrete in m...
Challenges and solutions for improved durability of materials - Concrete in m...Sirris
 
Challenges and solutions for improved durability of materials - Coatings done...
Challenges and solutions for improved durability of materials - Coatings done...Challenges and solutions for improved durability of materials - Coatings done...
Challenges and solutions for improved durability of materials - Coatings done...Sirris
 
Futureproof by sirris- product of the future
Futureproof by sirris- product of the futureFutureproof by sirris- product of the future
Futureproof by sirris- product of the futureSirris
 
2018 11-07-verbinden-ongelijksoortige-materialen-hupico multimaterial welding
2018 11-07-verbinden-ongelijksoortige-materialen-hupico multimaterial welding2018 11-07-verbinden-ongelijksoortige-materialen-hupico multimaterial welding
2018 11-07-verbinden-ongelijksoortige-materialen-hupico multimaterial weldingSirris
 
2018 11-07-verbinden-ongelijksoortige-materialen-bil ongelijksoortige materia...
2018 11-07-verbinden-ongelijksoortige-materialen-bil ongelijksoortige materia...2018 11-07-verbinden-ongelijksoortige-materialen-bil ongelijksoortige materia...
2018 11-07-verbinden-ongelijksoortige-materialen-bil ongelijksoortige materia...Sirris
 
2018 11-07-verbinden-ongelijksoortige-materialen-sirris bil-flanders_make_mmj
2018 11-07-verbinden-ongelijksoortige-materialen-sirris bil-flanders_make_mmj2018 11-07-verbinden-ongelijksoortige-materialen-sirris bil-flanders_make_mmj
2018 11-07-verbinden-ongelijksoortige-materialen-sirris bil-flanders_make_mmjSirris
 
2018 11-07-verbinden-ongelijksoortige-materialen-ku leuven-lijmen
2018 11-07-verbinden-ongelijksoortige-materialen-ku leuven-lijmen2018 11-07-verbinden-ongelijksoortige-materialen-ku leuven-lijmen
2018 11-07-verbinden-ongelijksoortige-materialen-ku leuven-lijmenSirris
 
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Lcv lasercladding for...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Lcv lasercladding for...Slotevent ‘Verbinden van ongelijksoortige materialen’ - Lcv lasercladding for...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Lcv lasercladding for...Sirris
 
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Juno industries mecha...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Juno industries mecha...Slotevent ‘Verbinden van ongelijksoortige materialen’ - Juno industries mecha...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Juno industries mecha...Sirris
 
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Castolin verbinden v...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Castolin  verbinden v...Slotevent ‘Verbinden van ongelijksoortige materialen’ - Castolin  verbinden v...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Castolin verbinden v...Sirris
 
Masterclass Mechatronics 4.0 - Indoor and outdoor localisation and positionin...
Masterclass Mechatronics 4.0 - Indoor and outdoor localisation and positionin...Masterclass Mechatronics 4.0 - Indoor and outdoor localisation and positionin...
Masterclass Mechatronics 4.0 - Indoor and outdoor localisation and positionin...Sirris
 

Plus de Sirris (20)

Presentation - webinar embedded machine learning
Presentation - webinar embedded machine learningPresentation - webinar embedded machine learning
Presentation - webinar embedded machine learning
 
2 - Pattyn - Smart Products Webinar 03-02-2023.
2 - Pattyn - Smart Products Webinar 03-02-2023.2 - Pattyn - Smart Products Webinar 03-02-2023.
2 - Pattyn - Smart Products Webinar 03-02-2023.
 
2021 01-27 - webinar - Corrosie van 3D geprinte onderdelen
2021 01-27 - webinar - Corrosie van 3D geprinte onderdelen2021 01-27 - webinar - Corrosie van 3D geprinte onderdelen
2021 01-27 - webinar - Corrosie van 3D geprinte onderdelen
 
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
 
20200923 inside metal am webinar_laborelec
20200923 inside metal am webinar_laborelec20200923 inside metal am webinar_laborelec
20200923 inside metal am webinar_laborelec
 
20200923 inside metal am webinar sirris-crm
20200923 inside metal am webinar sirris-crm20200923 inside metal am webinar sirris-crm
20200923 inside metal am webinar sirris-crm
 
Challenges and solutions for improved durability of materials - Opin summary ...
Challenges and solutions for improved durability of materials - Opin summary ...Challenges and solutions for improved durability of materials - Opin summary ...
Challenges and solutions for improved durability of materials - Opin summary ...
 
Challenges and solutions for improved durability of materials - Hybrid joints...
Challenges and solutions for improved durability of materials - Hybrid joints...Challenges and solutions for improved durability of materials - Hybrid joints...
Challenges and solutions for improved durability of materials - Hybrid joints...
 
Challenges and solutions for improved durability of materials - Corrosion mon...
Challenges and solutions for improved durability of materials - Corrosion mon...Challenges and solutions for improved durability of materials - Corrosion mon...
Challenges and solutions for improved durability of materials - Corrosion mon...
 
Challenges and solutions for improved durability of materials - Concrete in m...
Challenges and solutions for improved durability of materials - Concrete in m...Challenges and solutions for improved durability of materials - Concrete in m...
Challenges and solutions for improved durability of materials - Concrete in m...
 
Challenges and solutions for improved durability of materials - Coatings done...
Challenges and solutions for improved durability of materials - Coatings done...Challenges and solutions for improved durability of materials - Coatings done...
Challenges and solutions for improved durability of materials - Coatings done...
 
Futureproof by sirris- product of the future
Futureproof by sirris- product of the futureFutureproof by sirris- product of the future
Futureproof by sirris- product of the future
 
2018 11-07-verbinden-ongelijksoortige-materialen-hupico multimaterial welding
2018 11-07-verbinden-ongelijksoortige-materialen-hupico multimaterial welding2018 11-07-verbinden-ongelijksoortige-materialen-hupico multimaterial welding
2018 11-07-verbinden-ongelijksoortige-materialen-hupico multimaterial welding
 
2018 11-07-verbinden-ongelijksoortige-materialen-bil ongelijksoortige materia...
2018 11-07-verbinden-ongelijksoortige-materialen-bil ongelijksoortige materia...2018 11-07-verbinden-ongelijksoortige-materialen-bil ongelijksoortige materia...
2018 11-07-verbinden-ongelijksoortige-materialen-bil ongelijksoortige materia...
 
2018 11-07-verbinden-ongelijksoortige-materialen-sirris bil-flanders_make_mmj
2018 11-07-verbinden-ongelijksoortige-materialen-sirris bil-flanders_make_mmj2018 11-07-verbinden-ongelijksoortige-materialen-sirris bil-flanders_make_mmj
2018 11-07-verbinden-ongelijksoortige-materialen-sirris bil-flanders_make_mmj
 
2018 11-07-verbinden-ongelijksoortige-materialen-ku leuven-lijmen
2018 11-07-verbinden-ongelijksoortige-materialen-ku leuven-lijmen2018 11-07-verbinden-ongelijksoortige-materialen-ku leuven-lijmen
2018 11-07-verbinden-ongelijksoortige-materialen-ku leuven-lijmen
 
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Lcv lasercladding for...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Lcv lasercladding for...Slotevent ‘Verbinden van ongelijksoortige materialen’ - Lcv lasercladding for...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Lcv lasercladding for...
 
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Juno industries mecha...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Juno industries mecha...Slotevent ‘Verbinden van ongelijksoortige materialen’ - Juno industries mecha...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Juno industries mecha...
 
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Castolin verbinden v...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Castolin  verbinden v...Slotevent ‘Verbinden van ongelijksoortige materialen’ - Castolin  verbinden v...
Slotevent ‘Verbinden van ongelijksoortige materialen’ - Castolin verbinden v...
 
Masterclass Mechatronics 4.0 - Indoor and outdoor localisation and positionin...
Masterclass Mechatronics 4.0 - Indoor and outdoor localisation and positionin...Masterclass Mechatronics 4.0 - Indoor and outdoor localisation and positionin...
Masterclass Mechatronics 4.0 - Indoor and outdoor localisation and positionin...
 

Dernier

PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServiceRenan Moreira de Oliveira
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Spring24-Release Overview - Wellingtion User Group-1.pdf
Spring24-Release Overview - Wellingtion User Group-1.pdfSpring24-Release Overview - Wellingtion User Group-1.pdf
Spring24-Release Overview - Wellingtion User Group-1.pdfAnna Loughnan Colquhoun
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceMartin Humpolec
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncObject Automation
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxYounusS2
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 

Dernier (20)

PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Spring24-Release Overview - Wellingtion User Group-1.pdf
Spring24-Release Overview - Wellingtion User Group-1.pdfSpring24-Release Overview - Wellingtion User Group-1.pdf
Spring24-Release Overview - Wellingtion User Group-1.pdf
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your Salesforce
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation Inc
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptx
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 

Sirris innovate2011 - Lily, Smart Data at scale made easy, Steven Noels, Outertought

  • 1. Smart data, Lily at scale madE easy from content storage to scaling smart data IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org
  • 2. the pain data need for distributed processing moore IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 2
  • 3. the pain » growth of data sets » smart businesses need to apply analytics to Smart data, activities at scale » doing business online means real-time madE easy » talent shortage IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 3
  • 4. LILY The Real-time Platform built for the Age of Data. We manage, track and measure your data and users, and do the mat(c)hmaking in-between: » provide you with business intelligence and analytics » harvest user profiles and learn their interests » dynamically engage your users using quality recommendations IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 4
  • 5. where would you use lily? » large collections of data » large groups of users » content repositories » e-commerce / retail » library catalogs » news / media » (media) asset management » product catalogs » ‘live’ archives » ... if you want to use big data, but you need easy. IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 5
  • 6. beyond content management marketing broadcast revenue product / service IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 6
  • 7. beyond content management: data + analytics recommendations call to action personalised revenue product / service audience data IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 7
  • 8. LILY 2.0: smart data SMARTER DATA data processing s relation recommendations semantic augmentation Analytics usage metrics domain knowledge patterns rules keywords lists ... IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 8
  • 9. roadmap » now: highly-scalable data repository: store, index and search » next: with real-time usage stats gathering and analytics » later: and built-in context- and user-sensitive recommendations » built on top of Google BigTable / HBase / Solr » identical, robust technology in use at Facebook, Twitter, StumbleUpon, Yahoo! » scales widely over distributed (cloud) infrastructure IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 9
  • 10. Lily Architecture (deployment) IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 10
  • 11. status june 2011 » Lily 1.0.1 released - developing since Q4/09 » some customers - DIY retail / media / news » e-commerce platform project » Lily as the data (integration) tier » first contrib: FrogPond (annotated Java <> Lily mapper) https://bitbucket.org/calmera/frogpond IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 11
  • 12. Next up: usage stats » sits in CRUD-path » tracks users ops against records interactions » from both perspectives record user » arbitrary K/V properties: time, location, ... rec » automatically builds user om me nd ati o profiles (as records) ns indexes e tim » tied to records ops » indexed access » time dimension: trending IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 12
  • 13. from usage stats to recommendations ‘light’ record user » grouping of users based on » shared properties » shared record access » grouping of records based on » shared properties { connections » shared user operations recommendations IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 13
  • 14. full-on recommendations » look at real-time-capable Mahout algorithms » pre-index or -calculate as much as possible » save as secondary indexes » present recommendations as part of record API » allow user to contribute ‘domain knowledge’ to record processing pipeline » pattern detection, keywords, ontologies, ... IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 14
  • 15. timeline » Lily + usage stats 10/2011 » Lily + usage stats + light-weight analytics 12/2011 » Lily + recommendations ‘light’ 3/2012 » Lily 2.0 : full-on recommendations 6/2012 IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 15
  • 16. WHERE? www.lilyproject.org IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 16
  • 17. lily enterprise » adds tools: » yum/deb package repo » cluster deploy scripts (also EC2) » Admin UI » + enterprise support IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org 17
  • 18. Thank you ! for your attention for your questions » stevenn@outerthought.org » @stevenn IIC » TECHNOLOGIEPARK 3 » B-9052 ZWIJNAARDE (GENT) » www.outerthought.org