Azure Search is a Microsoft service that exists already for a while. But many do not know powerful and how easy this service is to use. In this demo based session I will show all the different functionalities of this services but also how you can extend it.

1. Knowledge Mining with
Cognitive Search (Whats New?)
Sammy Deprez

2. • Husband, Father of 2
• Partner at
• Core Member at
• Passionate about #Data and #AI
• Belgian
organizer
• “AITalk” Host
Hi There!

3. • What is Cognitive Search
• Quick Setup
• New features

4. What is Cognitive Search

5. What is Cognitive Search?

6. What is Cognitive Search?
• Free form text search
• Relevance
• Geo-search
• Filter and facets
• UX

7. What is Cognitive Search?
Data Source
Skillset
Index
Indexer

8. General new stuff
• Knowledge Store
• Soft Delete
• Updating
• Skillls
• Index
• Indexer
• Data Source
• Incremental Enrichment
• WebApp Designer

9. New Skills
• PII (Personal Identity Identifier)
• TextTranslation
• Custom Entity
• TextTranslation

10. Questions?
Now or
@sammydeprez

11. Code Snippets (Enable Delete, DataSource)
{
"@odata.context": "https://acs-demo.search.windows.net/$metadata#datasources/$entity",
"@odata.etag": ""0x8D7D4E9B760831D"",
"name": "demodata",
"description": null,
"type": "azureblob",
"subtype": null,
"credentials": {
"connectionString": "DefaultEndpointsProtocol=https;AccountName****************"
},
"container": {
"name": "data",
"query": null
},
"dataChangeDetectionPolicy": null,
"dataDeletionDetectionPolicy" : {
"@odata.type" :"#Microsoft.Azure.Search.NativeBlobSoftDeleteDeletionDetectionPolicy"
}
}

12. Code Snippets (PII Skill)
{
"@odata.type": "#Microsoft.Skills.Text.PIIDetectionSkill",
"defaultLanguageCode": "en",
"minimumPrecision": 0.5,
"maskingMode": "replace",
"maskingCharacter": "*",
"inputs": [
{
"name": "text",
"source": "/document/merged_content/translated_text"
}
],
"outputs": [
{
"name": "piiEntities"
},
{
"name": "maskedText"
}
]
},

13. Code Snippets (Custom Entity Skill)
{
"@odata.type": "Microsoft.Skills.Text.CustomEntityLookupSkill",
"context": "/document",
"entitiesDefinitionUri": “****.json",
"inputs": [
{
"name": "text",
"source": "/document/merged_content/translated_text"
}
],
"outputs": [
{
"name": "entities",
"targetName": "matchedEntities"
}
]
}

14. Code Snippets (Custom Entity Json)
[
{
"name" : "Sammy Deprez",
"description" : "Managing Partner at Arinti" ,
"aliases" : [
{ "text" : "depresa", "caseSensitive" : false },
{ "text" : "SammyD", "caseSensitive" : true }
]
}
]

15. Code Snippets (Incremental Enrichment ,
Indexer)
"cache": {
"enableReprocessing": true,
"storageConnectionString":
"DefaultEndpointsProtocol=https;AccountName=saacsdemo;AccountKey=
nXPGESbY6VfVgaLnQFyn53TCTERKHC/Ch2rJJrUktZc7a/fjLpe9aIeMLeJH4
g9RTiLkICPVyWkBSA9tE7i/3A==;EndpointSuffix=core.windows.net"
}

16. Code Snippets (PII + Custom Entity Mapping
Indexer)
{
"sourceFieldName": "/document/piiEntities",
"targetFieldName": "piiEntities",
"mappingFunction": null
},
{
"sourceFieldName": "/document/maskedText",
"targetFieldName": "maskedText",
"mappingFunction": null
},
{
"sourceFieldName": "/document/matchedEntities",
"targetFieldName": "customEntities",
"mappingFunction": null
}

17. {
"name": "piiEntities",
"type": "Collection(Edm.ComplexType)",
"fields": [
{ "name": "text", "type": "Edm.String" },
{ "name": "type", "type": "Edm.String" },
{ "name": "subtype", "type": "Edm.String" },
{ "name": "offset", "type": "Edm.Int32" },
{ "name": "length", "type": "Edm.Int32" },
{ "name": "score", "type": "Edm.Double" }
]
},
{
"name": "maskedText",
"type": "Edm.String"
},
{
"name": "customEntities",
"type": "Collection(Edm.ComplexType)",
"fields": [
{ "name": "name", "type": "Edm.String" },
{ "name": "description", "type": "Edm.String" },
{ "name": "id", "type": "Edm.String" },
{
"name": "matches",
"type": "Collection(Edm.ComplexType)",
"fields": [
{ "name": "text", "type":
"Edm.String" },
{ "name": "offset", "type":
"Edm.Int32" },
{ "name": "length", "type":
"Edm.Int32" },
{ "name": "matchDistance", "type":
"Edm.Double" }
]
}
]
}
Code Snippets (PII + Custom Entity Fields ,
Index)