Servers are like snowmen - and virtualization is cool!Jason Samuels
This document discusses server virtualization and its benefits. It provides an example of how a nonprofit organization called NCFR virtualized their servers, reducing their physical servers from four to two. Some key benefits of virtualization discussed are increased efficiency through better utilization of computing resources, reliability through redundancy if physical hardware fails, and reduced vulnerability by avoiding complete server rebuilds if crashes occur. The document also discusses potential future virtualization of applications, desktops, mobile devices, and infrastructure in the cloud.
This document discusses open data and open government initiatives. It provides examples of open data portals from different countries and municipalities. It outlines the benefits of open data for informing citizens, fueling innovation, and increasing government transparency and accountability. The document advocates for modernizing Quebec's access to information laws and developing an open data portal and strategy for Montreal. It provides examples of civic applications and startups that have used open data. The overall message is that open data and open government can strengthen democracy.
Servers are like snowmen - and virtualization is cool!Jason Samuels
This document discusses server virtualization and its benefits. It provides an example of how a nonprofit organization called NCFR virtualized their servers, reducing their physical servers from four to two. Some key benefits of virtualization discussed are increased efficiency through better utilization of computing resources, reliability through redundancy if physical hardware fails, and reduced vulnerability by avoiding complete server rebuilds if crashes occur. The document also discusses potential future virtualization of applications, desktops, mobile devices, and infrastructure in the cloud.
This document discusses open data and open government initiatives. It provides examples of open data portals from different countries and municipalities. It outlines the benefits of open data for informing citizens, fueling innovation, and increasing government transparency and accountability. The document advocates for modernizing Quebec's access to information laws and developing an open data portal and strategy for Montreal. It provides examples of civic applications and startups that have used open data. The overall message is that open data and open government can strengthen democracy.
Big data refers to the massive amounts of data being created from various sources such as social media posts, website transactions, and sensor readings. It is characterized by its volume, velocity, and variety. New technologies and the digitization of information have led to an explosion in big data. Tools like Hadoop, R, and Hive help analyze big data across distributed systems. Analyzing big data can reveal patterns and make predictions to help organizations make better decisions. Open data and APIs also make some big data publicly available for analysis.
This document provides an introduction to MapReduce and describes how to process stock market data using MapReduce. It explains how the data is split into input splits that are assigned to mappers. The custom MarketCapitalizationMapper and MarketCapitalizationReducer classes are used to calculate the market capitalization for each stock symbol by multiplying the stock price and volume. The mapper emits key-value pairs that are sorted and sent to reducers, and the reducer outputs the highest market cap for each symbol. Sample output is shown listing the market caps for different stock symbols.
hack/reduce is a community and hackspace for working with big data that provides access to a computing cluster, holds regular hackathons, and allows users to work with large datasets containing millions or billions of records using tools like Hadoop and MapReduce to find patterns and extract new information. The computing cluster has 240 cores, 240GB of RAM, and 10TB of disk space available for exploring open datasets like government documents, weather records, and transportation data.
Conférence corruption Institut du nouveau monde (INM)montrealouvert
Conférence lors de l'évènement Hackons la Corruption par Miriam Fahmy, Directrice, recherche et publications, Institut du Nouveau Monde, à propos de la corruption au Québec.
This document discusses visualizing open government data from Canadian federal travel and hospitality expenses from 2008. It describes scraping the non-open data from ministry websites, exploring and analyzing it using data visualization tools, and the challenges of extracting stories from unclear or incomplete data sources. Interactive visualizations were created to identify trends, quality issues, and unexpected findings in the expenses over time and across departments. The best story highlighted the need for truly open data.
Communautaire médias sociaux et démocratie directemontrealouvert
Presentation effectué lors du Activité collective de formation
Forum des intervenants municipaux en développement social (FIMDS)
Médias sociaux et démocratie directe
18 octobre 2012
This document discusses open data and provides examples of open data projects. It notes that open data is digital data that is made available without restrictions from copyright, patents or other mechanisms of control. Open data comes with an open license that allows anyone to access, use, modify, and share the data freely. It then provides examples of open data projects including MontrealPhotos.org, data from museums and archives, historical weather and map data, as well as talks and books about open data and information.
How to build an open data movement in your city, state, or province OKFN data...montrealouvert
1. The document discusses how to build an open data movement in a city/province/country by getting the right people involved, adopting a collaborative approach, understanding the local context, and being aware of the challenges.
2. It provides examples of open data initiatives in various jurisdictions and outlines key steps like developing a website, blog, and communications plan to engage stakeholders from government, the tech community, and the public.
3. The benefits of open data that are highlighted include economic growth through new applications and industries, increased government efficiency, greater transparency, and a more engaged democracy as citizens use data to learn about their communities and hold officials accountable.
Présentation avec l'équipe Gautrin à l'Assemblée Nationale à Québecmontrealouvert
Vous souvenez-vous de la consultation publique sur le Web 2.0? Après avoir soumis en ligne l’idée d’une politique de gouvernement ouvert au Québec et gagné l’appui de près de 100 personnes, Jean-Noé et Jonathan se sont déplacés à Québec pour faire une présentation sur l’ouverture des données au groupe de travail multi-ministériel Web 2.0. Les participants à cette rencontre ont accueilli très favorablement l’idée de rendre plus accessible les données du gouvernement provincial. Nous souhaitons qu’ils réussissent.
Big data refers to the massive amounts of data being created from various sources such as social media posts, website transactions, and sensor readings. It is characterized by its volume, velocity, and variety. New technologies and the digitization of information have led to an explosion in big data. Tools like Hadoop, R, and Hive help analyze big data across distributed systems. Analyzing big data can reveal patterns and make predictions to help organizations make better decisions. Open data and APIs also make some big data publicly available for analysis.
This document provides an introduction to MapReduce and describes how to process stock market data using MapReduce. It explains how the data is split into input splits that are assigned to mappers. The custom MarketCapitalizationMapper and MarketCapitalizationReducer classes are used to calculate the market capitalization for each stock symbol by multiplying the stock price and volume. The mapper emits key-value pairs that are sorted and sent to reducers, and the reducer outputs the highest market cap for each symbol. Sample output is shown listing the market caps for different stock symbols.
hack/reduce is a community and hackspace for working with big data that provides access to a computing cluster, holds regular hackathons, and allows users to work with large datasets containing millions or billions of records using tools like Hadoop and MapReduce to find patterns and extract new information. The computing cluster has 240 cores, 240GB of RAM, and 10TB of disk space available for exploring open datasets like government documents, weather records, and transportation data.
Conférence corruption Institut du nouveau monde (INM)montrealouvert
Conférence lors de l'évènement Hackons la Corruption par Miriam Fahmy, Directrice, recherche et publications, Institut du Nouveau Monde, à propos de la corruption au Québec.
This document discusses visualizing open government data from Canadian federal travel and hospitality expenses from 2008. It describes scraping the non-open data from ministry websites, exploring and analyzing it using data visualization tools, and the challenges of extracting stories from unclear or incomplete data sources. Interactive visualizations were created to identify trends, quality issues, and unexpected findings in the expenses over time and across departments. The best story highlighted the need for truly open data.
Communautaire médias sociaux et démocratie directemontrealouvert
Presentation effectué lors du Activité collective de formation
Forum des intervenants municipaux en développement social (FIMDS)
Médias sociaux et démocratie directe
18 octobre 2012
This document discusses open data and provides examples of open data projects. It notes that open data is digital data that is made available without restrictions from copyright, patents or other mechanisms of control. Open data comes with an open license that allows anyone to access, use, modify, and share the data freely. It then provides examples of open data projects including MontrealPhotos.org, data from museums and archives, historical weather and map data, as well as talks and books about open data and information.
How to build an open data movement in your city, state, or province OKFN data...montrealouvert
1. The document discusses how to build an open data movement in a city/province/country by getting the right people involved, adopting a collaborative approach, understanding the local context, and being aware of the challenges.
2. It provides examples of open data initiatives in various jurisdictions and outlines key steps like developing a website, blog, and communications plan to engage stakeholders from government, the tech community, and the public.
3. The benefits of open data that are highlighted include economic growth through new applications and industries, increased government efficiency, greater transparency, and a more engaged democracy as citizens use data to learn about their communities and hold officials accountable.
Présentation avec l'équipe Gautrin à l'Assemblée Nationale à Québecmontrealouvert
Vous souvenez-vous de la consultation publique sur le Web 2.0? Après avoir soumis en ligne l’idée d’une politique de gouvernement ouvert au Québec et gagné l’appui de près de 100 personnes, Jean-Noé et Jonathan se sont déplacés à Québec pour faire une présentation sur l’ouverture des données au groupe de travail multi-ministériel Web 2.0. Les participants à cette rencontre ont accueilli très favorablement l’idée de rendre plus accessible les données du gouvernement provincial. Nous souhaitons qu’ils réussissent.