Horizontal decomposition of freebase

•Télécharger en tant que PPTX, PDF•

2 j'aime•1,165 vues

This document analyzes the composition of Freebase data and finds that 29-41% of accepted triples (links and other facts) account for most of the information value, while the "a" predicate is very common but less informative. Descriptions take up a lot of space but keys are duplicated and inconsistent. Around 30% of facts, file size and compressed size are from links, which provide the most evidentiary value in Freebase.

Technologie

Horizontal Decomposition of
Freebase
based on data sampled in July

Summary
• 29-41% of accepted triples (links + other) hold
most of the value
• “a” is numerous but doesn’t provide the
evidence other predicates do
• “descriptions” are bulky
• “names” are not machine readable
• “keys” are duplicated, nonstandard, optional

a
5%
description
18%
key
11%
keyNs
13%label
6%
name
6%notability
0%
nfp
0%
text
8%
web
6%
links
20%
other
7%
percentage of gz compressed size

a
16%
description
1%
key
9%
keyNs
11%
label
6%
name
6%
notability
2%
nfp
2%
text
0%
web
5%
links
32%
other
10%
percentage of facts

a
15%
description
7%
key
8%
keyNs
9%
label
4%
name
4%
notability
2%
nfp
1%
text
3%
web
6%
links
30%
other
11%
percentage of uncompressed size

:BaseKB and Infovore
Data processed with Infovore software
https://github.com/paulhoule/infovore/
Get segmented Freebase data at
http://basekb.com/

Contenu connexe

Plus de Paul Houle

Cisco Fog Strategy For Big and Smart Data

Paul Houle

Although animals do not use language, they are capable of many of the same kinds of cognition as us; much of our experience is at a non-verbal level. Semantics is the bridge between surface forms used in language and what we do and experience. Language understanding depends on world knowledge (i.e. “the pig is in the pen” vs. “the ink is in the pen”) We might not be ready for executives to specify policies themselves, but we can make the process from specification to behavior more automated, linked to precise vocabulary, and more traceable. Advances such as SVBR and an English serialization for ISO Common Logic means that executives and line workers can understand why the system does certain things, or verify that policies and regulations are implemented

Making the semantic web work

Paul Houle

Ontology2 platform

Paul Houle

Ontology2 Platform Evolution

Paul Houle

Paul houle the supermen

Paul Houle

Paul houle what ails enterprise search

Paul Houle

This graph compares two importance scores for DBpedia concepts. x-axis (left) is a usage-based importance score (based on which pages people view) and y-axis (up) is the PageRank score published by ath representing the strength of links to a concept. Correlation coefficients via kendal, spearman and pearson are in the 0.35-0.5 range. Be warned that this system does not have a sense of "respectability" so you be offended by many of its opinions and we apologize for it.

Subjective Importance Smackdown

Paul Houle

Extension methods are the most controversial feature that Microsoft has introduced in C# 3.0. Introduced to support the LINQ query framework, extension methods make it possible to define new methods for existing classes. Although extension methods can greatly simplify code that uses them, many are concerned that they could transform C# into something that programmers find unrecognizable, or that C#’s namespace mechanisms are inadequate for managing large systems that use extension methods. Adoption of the LINQ framework, however, means that extension methods are here to stay, and that .net programmers need to understand how to use them effectively, and, in particular, how extension methods are different from regular methods. This article discusses three ways in which extension methods differ from regular methods: 1. Extension methods can be called on null objects without throwing an exception 2. Extension methods cannot be called inside of a subclass

Extension methods, nulls, namespaces and precedence in c#

Paul Houle

I got started with relational databases with mysql, so I’m in the habit of making database changes with SQL scripts, rather than using a GUI. Microsoft SQL Server requires that we specify the name of a unique constraint when we want to drop it. If you’re thinking ahead, you can specify a name when you create the constraint; if you don’t, SQL Server will make up an unpredictable name, so you can’t write a simple script to drop the constraint.

Dropping unique constraints in sql server

Paul Houle

This is a story of two types: GenericType and SpecificType, where GenericType is a superclass of SpecificType. There are two types of explicit cast in C#: The Prefix cast: [01] GenericType g=...; [02] SpecificType t=(SpecificType) g; The as cast: [03] GenericType g=...; [04] SpecificType t=g as SpecificType; Most programmers have a habit of using one or the other — this isn’t usually a conscious decision, but more of a function of which form a programmer saw first. I, for instance, programmed in Java before I learned C#, so I was already in the prefix cast habit. People with a Visual Basic background often do the opposite. There are real differences between the two casting operators

Prefix casting versus as-casting in c#

Paul Houle

I'm an expert on building commerical large scale systems based on Linked Data sources such as Freebase and DBpedia. I'm the creator of :BaseKB, which was the first correct conversion of Freebase to RDF and of Infovore, the open source I do consulting on the following areas: * Data processing with Hadoop and the design and construction of systems using Amazon Web Services * Architecture and construction of systems that consume and produce Linked Data * Construction and evaluation of intelligent systems that make subjective decisions (text search, text classification, machine learning, etc.) I'm not at all interested in doing maintenance work on other people's code, but I am interested in helping you align your process, structure, and tools to speed up your development cycle, improve your products, and prevent developer burnout. I am not free to relocate at this time, but I collaborate all of the time with workers around the world and I can travel to your location, understand your needs and transfer skills to your workforce.

Paul houle resume

Paul Houle

There’s a lot of confusion about how asynchronous communication works in RIA’s such as Silverlight, GWT and Javascript. When I start talking about the problems of concurrency control, many people tell me that there aren’t any concurrency problems since everything runs in a single thread. [1] It’s important to understand the basics of what is going on when you’re writing asynchronous code, so I’ve put together a simple example to show how execution works in RIA’s and how race conditions are possible. This example applies to Javascript, Silverlight, GWT and Flex, as well as a number of other environments based on Javascript. This example doesn’t represent best practices, but rather what can happen when you’re not using a proactive strategy that eliminates concurrency problems

Keeping track of state in asynchronous callbacks

Paul Houle

Mat Byrne recently posted source code for a dynamic domain object in PHP which takes advantage of the dynamic nature of PHP. It’s a good example of how programmers can take advantage of the unique characteristics of a programming language. Statically typed languages such as C# and Java have some advantages: they run faster and IDE’s can understand the code enough to save typing (with your fingers), help you refactor your code, and help you fix errors. Although there’s a lot of things I like symfony, it feels like a Java framework that’s invaded the PHP world. Eclipse would help you deal with the endless getters and setters and domain object methods with 40-character names in Java, Eclipse. The limits of polymorphism are a serious weakness of today’s statically typed languages. C# and Java apps that I work with are filled with if-then-else or case ladders when they need to initialize a dynamically chosen instance of one of a set of classes that subclass a particular base class or that implement a particular interface. Sure, you can make a HashMap or Dictionary that’s filled with Factory objects, but any answer for that is cumbersome. I

Embrace dynamic PHP

Paul Houle

articles on asynchronous communications with a focus on Javascript. Minimizing Code Paths In Asynchronous Code, a recent post of his, is about a lesson that I learned the hard way with GWT that applies to all RIA systems that use asynchronous calls. His example is the same case I encountered, where a function might return a value from a cache or might query the server to get the value: an obvious way to do this in psuedocode is: function getData(...arguments...,callback) { if (... data in cache...) { callback(...cached data...); } cacheCallback=anonymousFunction(...return value...) { ... store value in cache... callback(...cached data...); } getDataFromServer(...arguments...,cacheCallback) } At first glance this code looks innocuous, but there’s a major difference between what happens in the cached and uncached case. In the cached case, the callback() function gets called before getData() returns — in the uncached case, the opposite happens. What happens in this function has a global impact on the execution of the program, opening up two code paths that complicate concurrency control and introduce bugs that can be frustrating to debug. This function can be made more reliable if it schedules callback() to run after the thread it is running in completes. In Javascript, this can be done with setTimeout(). In Silverlight use System.Windows.Threading.Dispatcher. to schedule the callback

Once asynchronous, always asynchronous

Paul Houle

This article is a follow up to “Don’t Catch Exceptions“, which advocates that exceptions should (in general) be passed up to a “unit of work”, that is, a fairly coarse-grained activity which can reasonably be failed, retried or ignored. A unit of work could be: an entire program, for a command-line script, a single web request in a web application, the delivery of an e-mail message the handling of a single input record in a batch loading application, rendering a single frame in a media player or a video game, or an event handler in a GUI program The code around the unit of work may look something like [01] try { [02] DoUnitOfWork() [03] } catch(Exception e) { [04] ... examine exception and decide what to do ... [05] } For the most part, the code inside DoUnitOfWork() and the functions it calls tries to throw exceptions upward rather than catch them. To handle errors correctly, you need to answer a few questions, such as Was this error caused by a corrupted application state? Did this error cause the application state to be corrupted? Was this error caused by invalid input? What do we tell the user, the developers and the system administrator? Could this operation succeed if it was retried? Is there something else we could do? Although it’s good to depend on existing exception

What do you do when you’ve caught an exception?

Paul Houle

Extension methods, nulls, namespaces and precedence in c#

Paul Houle

ProAlign Web is sold on a “Software as a Service” basis, which eliminates the burden and costs of software installation, maintenance, and any server requirements. Upgrades happen seamlessly without your involvement. Users have permission levels for manipulating and viewing data — the system will show only those geographic areas authorized for each user. It's easy to create, share, modify and approve alignments online — visualization tools allow immediate understanding of key account metrics by territory Built in communication — allows integrated notes, requests and approval processes. Every installation of ProAlign Web is fully integrated with and includes ProAlign Desktop. Built on ESRI ArcGIS ® mapping technology, the world’s number one mapping software. ProAlign Desktop offers an additional robust portfolio of analytical, database and mapping features for the sales manager or sales operations analyst.

Pro align snap 2

Paul Houle

Companies with large, decentralized sales forces, multiple layers of sales management, and a collaborative approach to managing sales territories are a perfect fit for ProAlign Web sales territory alignment software. You can cooperatively create, modify and share territory alignments online, gaining input from sales managers anywhere in your organization who have the local account and customer knowledge critical to designing optimal territories. Sometimes getting field and local sales personnel involved can be a logistics challenge and lead to delays in completing new territory assignments. Not anymore. ProAlign Web provides secure online access for authorized sales management to view and propose changes to territory alignments. You’ll save weeks on complex sales territory projects.

Proalign Snapshot 1

Paul Houle

TextWise has recently developed Semantic Gist® to provide intuitive semantic modeling on a large number of samples, particularly vertical text documents that often do not have classification schemes associated with them. These semantic models will automatically adapt to rapidly changing content, ensuring a high level of accuracy over time. Semantic Gist® represents a significant advance in the use of machine learning, image and speech characterization, and neural networks to attack unsupervised semantic modeling. Our patent-pending approach generates a compact representation of any text by using advanced statistical language models to identify the significant features of a document. An auto-encoder neural network encodes the features into a low-dimensionality semantic representation, and then reconstructs an approximation of the original feature vector from the semantic representation. The software highlights keywords that may be underrepresented by the semantic representation and encodes these separately as a complementary feature vector. Finally, the complementary feature vector is combined with the semantic representation to produce a Semantic Gist® that can be easily used for document indexing, matching and other applications.

Text wise technology textwise company, llc

Paul Houle

User management is essential for community and interactive web systems. User management is often an afterthought in a project; although it is critical to the usability (a user that can't register log in can't use the service) and managability of a site, developers often build ad hoc solutions that are unreliable, insecure and hard to use. Tapir User Manager is a user management system that's been used to support large traffic sites. This presentation introduces TUM and explains how it's been used for projects at CUL and elsewhere.

Tapir user manager

Paul Houle

Plus de Paul Houle (20)

Cisco Fog Strategy For Big and Smart Data

Making the semantic web work

Ontology2 platform

Ontology2 Platform Evolution

Paul houle the supermen

Paul houle what ails enterprise search

Subjective Importance Smackdown

Extension methods, nulls, namespaces and precedence in c#

Dropping unique constraints in sql server

Prefix casting versus as-casting in c#

Paul houle resume

Keeping track of state in asynchronous callbacks

Embrace dynamic PHP

Once asynchronous, always asynchronous

What do you do when you’ve caught an exception?

Extension methods, nulls, namespaces and precedence in c#

Pro align snap 2

Proalign Snapshot 1

Text wise technology textwise company, llc

Tapir user manager

Dernier

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

apidays

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

ICT role in 21st century education and its challenges

rafiqahmad00786416

Vector Search -An Introduction in Oracle Database 23ai.pptx

Remote DBA Services

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

When you’re building (micro)services, you have lots of framework options. Spring Boot is no doubt a popular choice. But there’s more! Take Quarkus, a framework that’s considered the rising star for Kubernetes-native Java. It always depends on what's best for your situation, but how to choose the best solution if you're comparing 2 frameworks? Both Spring Boot and Quarkus have their positives and negatives. Let us compare the two by live coding a couple of common use cases in Spring Boot and Quarkus. After this talk, you’ll be ready to get started with Quarkus yourself, and know when to select Quarkus or Spring Boot.

Spring Boot vs Quarkus the ultimate battle - DevoxxUK

Jago de Vreede

Passkeys: Developing APIs to enable passwordless authentication Cody Salas, Sr Developer Advocate | Solutions Architect - Yubico Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

apidays

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

The presentation was made in “Web3 Fusion: Embracing AI and Beyond” is more than a conference; it's a journey into the heart of digital transformation. The conference a provided a platform where the future of technology meets practical application. This three-day hybrid event, set in the heart of innovation, served as a gateway to the latest trends and transformative discussions in AI, Blockchain, IoT, AR/VR, and their collective impact on the information space.

AI in Action: Real World Use Cases by Anitaraj

AnitaRaj43

Introduction to use of FHIR Documents in ABDM

Kumar Satyam

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

Discover the innovative features and strategic vision that keep WSO2 an industry leader. Explore the exciting 2024 roadmap of WSO2 API management, showcasing innovations, unified APIM/APK control plane, natural language API interaction, and cloud native agility. Discover how open source solutions, microservices architecture, and cloud native technologies unlock seamless API management in today's dynamic landscapes. Leave with a clear blueprint to revolutionize your API journey and achieve industry success!

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

Dernier (20)

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

ICT role in 21st century education and its challenges

Vector Search -An Introduction in Oracle Database 23ai.pptx

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Spring Boot vs Quarkus the ultimate battle - DevoxxUK

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Artificial Intelligence Chap.5 : Uncertainty

AI in Action: Real World Use Cases by Anitaraj

Introduction to use of FHIR Documents in ABDM

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

presentation ICT roal in 21st century education

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

FWD Group - Insurer Innovation Award 2024

WSO2's API Vision: Unifying Control, Empowering Developers

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...