Formal 8 – Interaction Models – describing general properties of systems including undo

•Télécharger en tant que PPTX, PDF•

0 j'aime•259 vues

Slides for the Formal Methods in HCI unit of my 2013 online course on HCI https://hcibook.com/hcicourse/2013/unit/09-formal * the PIE model * properties – WYSIWYG * proving things – undo * modelling artistic performance

Technologie

 interaction models
talking generally



interaction models
generic models of classes of system
mainly to aid understanding of general issues
e.g. undo and ‘back’ button

the PIE model
‘minimal’ model of interactive system
focused on external observable aspects of
interaction

PIE model – user input
sequence of commands
commands include:
– keyboard, mouse movement, mouse click
call the set of commands C
call the sequence P
P = seq C

PIE model – system response
the ‘effect’
effect composed of:
ephemeral display
the final result
(e..g printout, changed file)
call the set of effects E

PIE model – the connection
given any history of commands (P)
there is some current effect
call the mapping the interpretation (I)
I: P  E

properties – WYSIWYG
 predict  ( D  R ) s.t. predict o display = result
but really not quite the full meaning
result
display

proving things – undo
 c : c undo ~ null ?
but cannot work for c = undo

lesson
undo is no ordinary command!
other meta-commands:
back/forward in browsers
history window
later analysis of ‘back’ button and history
in hypertext and web browsers …
‘back’ was different in them all!

… another domain …
… artistic performance
yes formal methods meets art!!
work with Jenn Sheridan Stuart Reeves,
Steve Benford, and Claire O’Malley

Performer
ObserverParticipant
tripartite interaction
who knows what?
witting or unwitting

spheres of influence and perception
phenomena directly
influenced by A
phenomena indirectly
influenced by A
A
phenomena directly
perceived by B
B
phenomena indirectly
perceived by B

spheres of influence and perception
A B
phenomena directly perceived by B
phenomena indirectly influenced by A phenomena indirectly perceived by B
phenomena directly influenced by A

the frame
performance?
A B
… but not sufficient
in the frame

the frame
the performer
A B
unwitting observer
… still not quite there ….
A B

the frame
audience belief
A B
A B
unwitting performer

Deus Oculi
A looks in mirror and
sees reflection
A B
B looks at screen
inside small doors
both are aware that mirror
and screen are within the frame
but unaware of the causal
link between mirror and screen
frame

Contenu connexe

Tendances

E3 chap-05

Hci md exam

Chapter 2

Hci activity#1

HCI 3e - Ch 19: Groupware

Alan Dix

What Is Interaction Design

Graeme Smith

Hci activity#2

Desalegn Aweke

The AI Summit London, 22nd Sept. 2021. https://www.alandix.com/academic/talks/AI-Summit-2021-UI-with-AI/ All AI ultimately affects people, in some cases deeply buried, in others interacting directly with users whether physically, such as autonomous vehicles, or virtually, such as recommender systems. In these interactions AI may be a servant, such as Alexa operating on command; or AI may be the master, such as gig-work platforms telling workers what to do. However, potentially the most productive interactions are a symbiosis, human and AI complimenting one another. Designing human-in-the-loop systems changes the requirements of both AI algorithms and user interfaces. This talk will explore some of the design principles and examples in this exciting area. Key Takeaways: * Deterministic ground – helping users know what may or may not adapt * Appropriate intelligence – tuning AI to offer human alternatives and fail well * Epistemic interaction – choosing user interactions that are informative for ML user interface, artificial intelligence, design, machine learning, deterministic ground, appropriate intelligence, alien intelligence, Epistemic interaction

Designing User Interactions with AI: Servant, Master or Symbiosis.

Alan Dix

HCI

Er. Arpit Sharma

HCI - Chapter 4

Alan Dix

Human Computer Interaction (HCI)

Lahiru Danushka

HCI - Chapter 6

Alan Dix

HCI 3e - Ch 4: Paradigms

Alan Dix

Presentation at HCI-E2: Workshop on HCI Engineering Education – for developers, designers and more, IFIP WG 2.7/13.4 and WG 13.1 joint workshop at INTERACT 2021, Bari, Italy – August 31st, 2021 https://www.alandix.com/academic/papers/IE4UX2021/ This talk describes a small unit for teaching interface implementation to user experience (UX) designers. Where human–computer interaction (HCI) textbooks and courses include aspects of user interface engineering, they are usually focused towards computer science students. The unit described here is part of a larger online HCI course where the majority of learners are UX professionals, who found it hard to understand why they needed to learn about implementation. The paper explains why the author felt it important to include aspects that help the UX designer understand the behavioural and practical implications of ‘low level’ coding, and also the elements included in the unit. The resulting unit includes many concrete examples linking user behaviour to internal structure and having produced the material, it seems that this may also be a good way to introduce the topic to more technical students before digging into lower level details.

Interface Engineering for UX Professionals

Alan Dix

Chapter1(hci)

Latesh Malik

HCI Presentation

Abdul Rasheed Memon

Hci [6]interaction design

Welly Dian Astika

Interaction Design

hcicourse

Design Issues with Microsft Word

Abdullah Shiam

Human Computer Interaction of an Information System

university of education,Lahore

Tendances (20)

E3 chap-05

Hci md exam

Chapter 2

Hci activity#1

HCI 3e - Ch 19: Groupware

What Is Interaction Design

Hci activity#2

Designing User Interactions with AI: Servant, Master or Symbiosis.

HCI

HCI - Chapter 4

Human Computer Interaction (HCI)

HCI - Chapter 6

HCI 3e - Ch 4: Paradigms

Interface Engineering for UX Professionals

Chapter1(hci)

HCI Presentation

Hci [6]interaction design

Interaction Design

Design Issues with Microsft Word

Human Computer Interaction of an Information System

Plus de Alan Dix

Talk at EPIC CDT Away Day, St Davids Hotel, Cardiff, 11th April 2024. https://alandix.com/academic/talks/CDT-away-day-April-2024-QQ/ As academics we need to deal with numbers including project management spreadsheets and student marks. In addition, they are part of day-to-day life whether household budgeting or working out how many socks to pack for a journey. Perhaps most crucially, many national and global issues require an understanding of numeric information from climate change to tax rates, and of course the Covid-19 pandemic. If citizens are not able to make sense of this, democracy fails. Of course, many are not only uncertain when dealing with numbers, but suffer more or less extreme maths anxiety. Indeed a recent UK survey found that, “over a third of adults (35%) say that doing maths makes them feel anxious, while one in five are so fearful it even makes them feel physically sick”. Sometimes detailed calculations are necessary, but often the critical skill is qualitative–quantitative reasoning, that is a qualitative understanding of quantitative phenomena. This can after be aided by the ability to use back-of-the-envelope calculations and dealing with lightweight numeric information. This talk discusses these issues and presents some prototype tools to explore the design space for personal numeric information. This talk is largely the same as the one of the same name given at Ulster University in February. However, the slides have been updated to correct web material misattributed to BBC which was actually Guardian. An eagle-eyed member of the audience spotted that the font in the screenshot was one found in the Guardian online web and not the BBC.

CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers

Alan Dix

Talk at the Computational Foundry, Swansea University, 24th April 2024. https://alandix.com/academic/talks/Swansea-song-April-2024/ This talk was my last formal act as Director of the Computational Foundry, before retiring from Swansea University at the end of April 2024. It was the last part in a research afternoon of the School of Mathematics and Computer Science, during which there were talks by other members of the school including a wonderful potted history of Maths and CS in the University and the Computational Foundry by John Tucker and Matt Jones. This talk is a summary (partial) of more personal research through my time at Swansea, some in collaboration with others across the university, some with those external to Swansea, and some more individual. The talk used a number of web-based prototypes and systems that I've developed, many as weekend projects, to look at areas including AI, digital humanities and heritage, qualitative-quantitative reasoning, statistics and maths education, physical prototyping and UX tools. The talk included work inspired by teaching, consultancy and other real-world problems, but almost always also including a strong theoretical dimension. This reflects my personal background, as the son of a carpenter, but where mathematics was my academic 'first love' -- always seeking out ways in which practical making and fundamental knowledge interact. A theme that runs through many of the examples is the way in which many if the things that were completed while at Swansea had roots before, and also things I started here will continue on the future. And now I look forward to the coming years; although my employment at Swansea has ended, I will continue to collaborate with many in the University, both those I have met since being in Swansea and those I know before.

Swan(sea) Song – personal research during my six years at Swansea ... and bey...

Alan Dix

From Family Reminiscence to Scholarly Archive .

Alan Dix

Rarely a day goes by without an AI story in the news. Sometimes, there is good news, such as the use of AI to discover a new pharmaceutical, but often more dark, about AI bias or the way it may rob us of jobs, privacy or autonomy. The human impact of AI is of two kinds. First, what AI does directly - systems that we use and can design better or worse. Second, how AI shapes society, the way AI can create mismatches of power between large corporations and nation states, and between organisations and individuals. Recent advances in large-langage models in particular may mean that AI is only in the hands of those who can afford massive computational power and technical expertise. However, there are signs of hope, in particular the way that generative AI might enable niches applications that would otherwise be impossible. In education this may allow personalised tuition, bit also changes what needs to be learnt ... not necessarily digital; the ability of LLMs to generalise may offer ways for minority languages to survive; and in health there is the possibility of personalised medicine, and affordable ways to help well-being and mental health.

Human-Centred Artificial Intelligence – Malta 2024

Alan Dix

talk to ACM SIGCHI Paris Chapter at Université Paris-Saclay, 19th March 2024. https://alandix.com/academic/talks/Paris-UX-2024/ From the 1980s graphical interfaces have dominated the way we envisage user interactions. While we know and teach our students about the importance of taking a wider perspective, the vast majority of tools used in practical UX (user experience) design are dominated by screens. In this talk I will explore ways in which future design can step beyond the pixelated surface. One strand is understanding the physical nature of devices, human bodies, and the environments within which they engage; this is addressed in my 2022 book “TouchIT – Understanding Design in a Physical-Digital World” co-authored with Steve Gill, Jo Hare, and Devina Ramduny-Ellis. The other strand is work over the last few years with Miriam Sturdee and Anna Carter, collectively entitled InContext, in which we have been exploring next generation UX tools, including investigative workshops and focus groups. While not a major issue, AI was mentioned in these workshops, but they were before the recent rise in awareness fostered by ChatGPT. I will contextualise this building on two other books that I am completing relating to AI and Human–Computer Interaction. I will demonstrate two tools that explore the space of design beyond the screen. One, ScenarioViewer enables screen-based prototypes, at various levels of fidelity, to be embedded within story-board-like contextual images. The other, PhysProto, allows physical prototypes to be interactively explored remotely using video clips and Physigrams, executable models of the physical behaviour of the device. These are prototypes of prototyping tools, but also provotypes, designed to provoke you to consider for yourself the future of UX design support tools.

The future of UX design support tools - talk Paris March 2024

Alan Dix

Seminar at University of Ulster, 21st February 2024. https://alandix.com/academic/talks/Ulster-2024-QQ/ As academics we need to deal with numbers including project management spreadsheets and student marks. In addition, they are part of day-to-day life whether household budgeting or working out how many socks to pack for a journey. Perhaps most crucially, many national and global issues require an understanding of numeric information from climate change to tax rates, and of course the Covid-19 pandemic. If citizens are not able to make sense of this, democracy fails. Of course, many are not only uncertain when dealing with numbers, but suffer more or less extreme maths anxiety. Indeed a recent UK survey found that, “over a third of adults (35%) say that doing maths makes them feel anxious, while one in five are so fearful it even makes them feel physically sick”. Sometimes detailed calculations are necessary, but often the critical skill is qualitative–quantitative reasoning, that is a qualitative understanding of quantitative phenomena. This can after be aided by the ability to use back-of-the-envelope calculations and dealing with lightweight numeric information. This talk discusses these issues and presents some prototype tools to explore the design space for personal numeric information.

Qualitative–Quantitative reasoning and lightweight numbers

Alan Dix

Invited talk at Diversifying Knowledge Production in HCI

Alan Dix

Invited talk at AMID 2023 – 1st International Workshop on Accessibility and Multimodal Interaction Design Approaches in Museums for People with Impairments, in conjunction with MoileHCI Conference, 26 Sept. 2023. https://alandix.com/academic/talks/AMID2023-exceptional/ Often accessibility is an afterthought or sticking plaster to fix the holes in an experience that was designed with a central audience in mind: maybe middle-aged, fully abled, well educated. Ideally we would have user experiences designed specifically for different kinds of modalities and in different tyles, not just because of the wide diversity of users, but also because any one user has varying needs and varying abilities at different times. In the context of a large museum or cultural institution this is already challenging, but appears impossible for smaller archives, or local community heritage. Yet if heritage and history is to be accessible this also applies to production, democratising digitisation and empowering marginalised groups.. We need appropriate architectures, tools, technology infrastructure and platforms, that make this not just possible, but simple. In this talk I offer some insights, some examples and many research challenges towards the goal of enabling exceptional experiences for everyone.

Exceptional Experiences for Everyone

Alan Dix

Keynote at 9th International Conference on Computing and Informatics (ICOCI 2023), "Nurturing an inclusive digital society for a sustainable nation", 13-14 September 2023, Kuala Lumpur, Malaysia https://alandix.com/academic/talks/ICOCI2023-keynote/ AI is transforming many sectors of the economy and our day-today lives. We hear of success stories including medical advances, but also worries that AI will destroy jobs or even be an existential threat to humanity. We also know that for previous waves of technology – mechanical, electronic and digital – the costs and benefits do not fall equally to everyone in society. There are clear dangers that AI will further entrench existing power and deepen the digital divide: both at an individual level and globally. For example, training foundation models, such as GPT-4, requires enormous computational power and massive data sets accessible only to the largest corporations. However, the ways in which these can be used generatively in more niche areas, offers potential for minority languages and individualised learning that was previously only accessible to the rich. Whether the threats of AI or its opportunities dominate is not simply an abstract question, but one that impacts the most disadvantaged around us, and one that, as researchers and practitioners in digital technology, we can affect. If we truly want an inclusive digital society, then we need to make it happen.

Inclusivity and AI: opportunity or threat

Alan Dix

Position paper presented at Engineering Interactive Systems Embedding AI Technologies at EICS 2023, Swansea, Wales, UK. 27 June. 2023. https://alandix.com/academic/papers/EISEAIT2023-hidden/ Many critical user interaction design decisions are made in the heat of detailed development. These include simple parameter choices or more complex weightings in intelligent algorithms. Many would be appropriate for expert design review, user-preference choices or optimisation by machine learning, but they are buried deep in the code. Although the developer may realise this potential, the location of the decision is far removed in the code from where user feedback occurs, data can be collected and machine learning could be applied. This position paper describes several case studies and use them to frame an architectural challenge for tools and infrastructure to uncover these hidden variables to make them available for machine learning and user inspection.

Hidden Figures architectural challenges to expose parameters lost in code

Alan Dix

Keynote at Creative AI Research Conference 2023 https://alandix.com/academic/talks/CAR2023-keynote/ Over the years many of the ‘red lines’ of artificial intelligence have been crossed: challenges that were deemed to require uniquely human understanding. In 1997, chess fell as Deep Blue defeated Kasparov; then, twenty years later, AlphaGo beat Ke Jie, the world’s top Go player. Arguably, game playing can be considered artificial and formal, not representing the rich nuanced nature of human intelligence embodied in the real world. However, large language models have challenged these assumptions producing dialogue and texts that appear human – passing the Turing test . Furthermore, the text, and poems generated by ChatGPT and images created by DALL-E appear almost creative. Has the last bastion fallen or is it merely the babbling of ‘stochastic parrots’? Is AI the ultimate charlatan peddling plagiarism or instead the child’s cry that reveals the emperor’s cloths of human creativity are sham? And what does it mean to be creative anyway? I will attempt, if not to answer these deep questions, at least lay down some pointers. We will test the limits of the myth of the individual innate genius with inspiration gifted by the muses; and explore the way creativity is always embodied in culture and technology. Yet, while artists and philosophers debate, the child draws on.

ChatGPT, Culture and Creativity simulacrum and alterity

Alan Dix

Talk given as part of Online Seminars on Human Computer Interaction and User Experience Presented by British Computer Society Interaction Group and Interacting with Computers, 27 February 2023 https://alandix.com/academic/talks/BCS-IwC-Covid-Feb-2023/ This talk draws on diverse psychological, behavioural and numerical literature to understand some of the challenges we all face in making sense of large-scale phenomena and use this to create a roadmap for HCI responses. This body of research points the way toward current challenges and equips us with tools and principles that can help HCI researchers deliver value. The talk is framed by looking at patterns and information that highlight some of the common misunderstandings that arise – not just for politicians and the general public but also for those in the academic community’s heart. This talk does not have all the answers to this, but we hope it provides some and, perhaps more importantly, raises questions that we need to address as scientific and technical communities.

Why pandemics and climate change are hard to understand and make decision mak...

Alan Dix

Keynote at Fifth European Tangible Interaction Studio, ENAC Toulouse. Nov. 7-10 2022. https://alandix.com/academic/talks/ETIS2022-keynote/ For many years interaction design was driven by the abstractions of WIMP (windows, icons, menus, pointer). The details differ on desktop applications, web pages or smart-phones and the ‘pointer’ has evolved from mice to trackpad and touch-based interactions, however, for many digital applications, the central aspects are unchanged. What is different is that the screens we encounter, as Weiser predicted, are everywhere: embedded in physical appliances such as showers and toasters and situated in office walls and building facades. Furthermore, we are often engaging with digital applications that have no obvious screen or where the screen if present is only a small part of the interaction; these include voice assistants, semi-autonomous vehicles, and smart cities. Even where the dominant interaction is focused on a screen, the places where we use them and the physical activities, we are doing fundamentally affect the nature of the interactive experience: using a smartphone while sitting in an armchair and watching television, is very different from thumbing a quick message whilst walking down a busy city road on a rainy night. In this talk I will describe several design techniques and prototype tools that seek to address the physicality of digital interactions including the physical nature of the device itself and the physical context in which it is placed. This will include ‘soft’ formal methods to describe physical aspects of devices, ways to use video to model physical prototypes during early design and tools to encourage designers to keep the context of use in mind even when working on largely screen-based interactions. The talk draws on some long-standing work, parts of the recently published book 'TouchIT: Understanding Design in a Physical-Digital World' (co-authored with Steve Gill, Devina Ramduny-Ellis, and Jo Hare) and the InContext project (in collaboration with Miriam Sturdee and Anna Carter). The latter arose from the realisation that despite the vast number of design tools available, nearly all focus entirely on the screen and wireframes. We are asking "what is the Next Generation of UX design tool?" – perhaps you would like to join this conversation.

Beyond the Wireframe: tools to design, analyse and prototype physical devices

Alan Dix

Keynote at the European Conference on Cognitive Ergonomics (ECCE 2022), Kaiserslautern, Germany, 7th Oct 2022. https://alandix.com/academic/talks/ECCE2022-keynote/ From prehistory to the internet age, humans have always lived as part of a technologically mediated world. Knapped flints have given way to touch-screens, cuneiform to CSS, but in both rapid hand-eye coordination and long-term social interactions, our experiences and actions in the world are embedded in a physical, mechanical, symbolic and digital nexus. After far too long in the writing, my co-authors and I are delighted that "TouchIT: Understanding Design in a Physical-Digital World" is finally published – symbolic words, recorded in digital media and printed on physical paper. This book covers established and emergent digital technology, but repeatedly the continuity of current and past technology, physical and digital worlds is evident. The fundamental cognitive resources that enable our digital existence in an age of constant flux are the result of aeons of development in a physical world that we remake and reimagine. In this talk I will explore multiple scales of digital interaction from seconds to years, informed by and illuminating what it means to be a fully embodied and richly reflective human.

Forever Cyborgs – a long view on physical-digital interaction

Alan Dix

Keynote at International Conference on Computer-Human Interaction Research and Applications (CHIRA 2022), Malta, 27-28 Oct 2022. https://alandix.com/academic/talks/CHIRA2022-keynote/ Politicians have always been economical with the truth and newspapers have toed an editorial line. However, never in recent times does it seem that confidence in our media has been lower. From the Brexit battle bus in the UK to suspected Russian meddling in US elections, fake news to alternative facts – it seems impossible for the general public to make sense of the contradictory arguments and suspect evidence presented both in social media and traditional channels. Even seasoned journalists and editors seem unable to keep up with the pace and complexity of news. These problems were highlighted during Covid when understanding of complex epidemiological data was essential for effective government policy and individual responses. If democracy is to survive and nations coordinate to address global crises, we desperately need tools and methods to help ordinary people make sense of the extraordinary events around them: to sift fact from surmise, lies from mistakes, and reason from rhetoric. Similarly, journalists need the means to help them keep track of the surfeit of data and information so that the stories they tell us are rooted in solid evidence. Crucially in increasingly politically fragmented societies, we need to help citizens explore their conflicts and disagreements, not so that they will necessarily agree, but so that they can more clearly understand their differences. These are not easy problems and do not admit trite solutions. However, there is existing work that offers hope: tracing the provenance of press images, ways to expose the arguments in political debate, tracking the influence of news on electoral opinion. I hope that this talk will give hope that we can make a difference and offer challenges for future research.

Truth in an Age of Information

Alan Dix

Seminar in University of Rome "La Sapienza", Friday, October 14th 2022. (Extended version of talk at AI Summit London 2021) All AI ultimately affects people, in some cases deeply buried, in others interacting directly with users, whether physically, such as autonomous vehicles, or virtually, such as recommender systems. In these interactions, AI may be a servant, such as Alexa operating on command; or AI may be the master, such as gig-work platforms telling workers what to do. However, potentially the most productive interactions are a symbiosis, human and AI complementing one another. Designing human-in-the-loop systems changes the requirements of both AI algorithms and user interfaces. This talk will explore some design principles and examples in this exciting area.

Rome Seminar: Designing User Interactions with AI

Alan Dix

Paper presented at British HCI Conference (BHCI2022), Keele, UK. 11-13 July 2022. https://www.alandix.com/academic/papers/BHCI2022-community/ This paper explores ways in which scholarly skill and expertise might be embodied in tools and sustainable practices that enable communities to create and manage their own digital archives. We focus particularly on tools and practices related to the recording and annotation of digitised materials. The paper is based on co-production practice in two very different kinds of community. Although the communities are different we find that tools designed specifically for one are valuable for others, thus offering the promise of general tools to support community-centred digitisation and potentially also traditional archival practice.

Tools and technology to support rich community heritage

Alan Dix

Presented at MAPII 2022 -- Map-based Interfaces and Interactions. 7th June 2022, Rome, Italy. https://www.alandix.com/academic/papers/MAPII-2022/ Maps are not mere simulacra of the ground, but imbued with meaning. This is true at a geopolitical scale, but even more so for local community mapping. However, whilst digital mapping has made it easy to embed and customise maps in local websites or printed resources, it also runs the risk of de-humanising these resources, replacing rich meaning with unnecessary precision. This paper explores examples of how meaning can sit alongside the digital in map-based interactions. It then uses this backdrop to consider new challenges to help a living community where their physical village has been all but obliterated.

Maps with Meaning

Alan Dix

Invited talk at AVI2CH 2022: Workshop on Advanced Visual Interfaces and Interactions in Cultural Heritage , Rome, Italy, 6th June https://alandix.com/academic/talks/AVI2CH-2022/ Local communities across the world have documents, artefacts and crucially memories that are precious but precarious. Digital tools to help communities record, curate and present their own heritage are important both for the life and empowerment of each community, and also to add to a broader historical body of knowledge. When designing digital interventions, there is an apparent tension between co-creating tools and processes that are meaningful for a particular community and creating generic tools that can be reused at scale. Tools created as part of ongoing engagements with two very different communities has shown that this apparent tension may be an illusion. Indeed, tools created very specifically for the local circumstances of one are also well-suited to the other. This is promising and suggests that it is possible to create human and technical infrastructure to democratise digitisation for cultural heritage in the small that has broad impact.

Democratising Digitisation Tools to Support Small Community Archives

Alan Dix

Keynote at AVI 2022: Advanced Visual Interfaces, Rome, Italy, 6-10 June 2022 https://alandix.com/academic/talks/ AVI2022-keynote/ As cultures and individuals, we look back to look forward, explicitly using lessons of the past to guide our future decisions. In this 30th anniversary of the AVI conference we can also look back in order to make the next 30 years even better. In 1996 I gave a keynote at the third AVI, both describing my own work in formal modelling of user interactions, and also pondering variations of ‘advanced visual interfaces’, imagining advanced aural and advanced nasal interfaces. This was part playful but also serious, uncovering the way our different senses give us different cuts through space and time. In particular, smell is deeply associated with memory both personal and spatial – that is history. In the meantime, scent has been used as a metaphor for information seeking, and now long-promised smell-based interfaces are beginning to emerge; we are about to enter an exciting world of multi-sensory experiences. However, it is on the metaphoric sense of advanced visual and nasal interaction that I want to focus now. The importance of tracing what is past and planning what is to come. This is true for our discipline as a whole, but also in moment-to-moment digital interactions. On the first of April this year, Nielsen Norman Group posted an article entitled “Support Recall Instead of Recognition in UI Design”. It was meant as an April Fool’s Day joke, but in fact the move towards gesture-based touch interactions means this is precisely how many feel today. This has exacerbated the long-term weaknesses of visual interaction heuristics and guidance when it comes to looking back, making it hard to ask, “why did that happen?”, or “how did I manage that?”, especially for older users or those who are less confident with digital technology. Finally, as we move forwards to tackle these and new issues, we need to constantly question what constitutes ‘advanced’: a fast-moving highway for a few or a wider frontier for everyone. The latter often poses the hardest design challenges but is most critical in a world where being digital is central to being a citizen.

Follow your nose: history frames the future

Alan Dix

Plus de Alan Dix (20)

CDT Away Day Talk: Qualitative–Quantitative reasoning and lightweight numbers

Swan(sea) Song – personal research during my six years at Swansea ... and bey...

From Family Reminiscence to Scholarly Archive .

Human-Centred Artificial Intelligence – Malta 2024

The future of UX design support tools - talk Paris March 2024

Qualitative–Quantitative reasoning and lightweight numbers

Invited talk at Diversifying Knowledge Production in HCI

Exceptional Experiences for Everyone

Inclusivity and AI: opportunity or threat

Hidden Figures architectural challenges to expose parameters lost in code

ChatGPT, Culture and Creativity simulacrum and alterity

Why pandemics and climate change are hard to understand and make decision mak...

Beyond the Wireframe: tools to design, analyse and prototype physical devices

Forever Cyborgs – a long view on physical-digital interaction

Truth in an Age of Information

Rome Seminar: Designing User Interactions with AI

Tools and technology to support rich community heritage

Maps with Meaning

Democratising Digitisation Tools to Support Small Community Archives

Follow your nose: history frames the future

Dernier

DBX First Quarter 2024 Investor Presentation

Dropbox

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

MINDCTI Revenue Release Quarter One 2024

MIND CTI

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

ICT role in 21st century education and its challenges

rafiqahmad00786416

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Exploring Multimodal Embeddings with Milvus

Zilliz

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

In this keynote, Asanka Abeysinghe, CTO,WSO2 will explore the shift towards platformless technology ecosystems and their importance in driving digital adaptability and innovation. We will discuss strategies for leveraging decentralized architectures and integrating diverse technologies, with a focus on building resilient, flexible, and future-ready IT infrastructures. We will also highlight WSO2's roadmap, emphasizing our commitment to supporting this transformative journey with our evolving product suite.

Platformless Horizons for Digital Adaptability

WSO2

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

Dernier (20)

DBX First Quarter 2024 Investor Presentation

Boost Fertility New Invention Ups Success Rates.pdf

MINDCTI Revenue Release Quarter One 2024

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

ICT role in 21st century education and its challenges

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Corporate and higher education May webinar.pptx

CNIC Information System with Pakdata Cf In Pakistan

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

How to Troubleshoot Apps for the Modern Connected Worker

Exploring Multimodal Embeddings with Milvus

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Understanding the FAA Part 107 License ..

Six Myths about Ontologies: The Basics of Formal Ontology

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Strategies for Landing an Oracle DBA Job as a Fresher

Platformless Horizons for Digital Adaptability

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Formal 8 – Interaction Models – describing general properties of systems including undo

1.  interaction models talking generally  

2. interaction models generic models of classes of system mainly to aid understanding of general issues e.g. undo and ‘back’ button

3. the PIE model ‘minimal’ model of interactive system focused on external observable aspects of interaction

4. PIE model – user input sequence of commands commands include: – keyboard, mouse movement, mouse click call the set of commands C call the sequence P P = seq C

5. PIE model – system response the ‘effect’ effect composed of: ephemeral display the final result (e..g printout, changed file) call the set of effects E

6. PIE model – the connection given any history of commands (P) there is some current effect call the mapping the interpretation (I) I: P  E

7. properties – WYSIWYG  predict  ( D  R ) s.t. predict o display = result but really not quite the full meaning result display

8. proving things – undo  c : c undo ~ null ? but cannot work for c = undo

9. lesson undo is no ordinary command! other meta-commands: back/forward in browsers history window later analysis of ‘back’ button and history in hypertext and web browsers … ‘back’ was different in them all!

10. … another domain … … artistic performance yes formal methods meets art!! work with Jenn Sheridan Stuart Reeves, Steve Benford, and Claire O’Malley

11. Performer ObserverParticipant tripartite interaction who knows what? witting or unwitting

12. spheres of influence and perception phenomena directly influenced by A phenomena indirectly influenced by A A phenomena directly perceived by B B phenomena indirectly perceived by B

13. spheres of influence and perception A B phenomena directly perceived by B phenomena indirectly influenced by A phenomena indirectly perceived by B phenomena directly influenced by A

14. oridinary interaction A B

15. the frame performance? A B … but not sufficient in the frame

16. the frame the performer A B unwitting observer … still not quite there …. A B

17. the frame audience belief A B A B unwitting performer

18. the frame performance A B B A B A B

19. Deus Oculi A looks in mirror and sees reflection A B B looks at screen inside small doors both are aware that mirror and screen are within the frame but unaware of the causal link between mirror and screen frame

20. Deus Oculi – tableaux of beliefs

Formal 8 – Interaction Models – describing general properties of systems including undo

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Plus de Alan Dix

Plus de Alan Dix (20)

Dernier

Dernier (20)

Formal 8 – Interaction Models – describing general properties of systems including undo