.NET Fest 2018. Николай Балакин. .NET Internals: управление памятью в стеке

•

0 j'aime•340 vues

Как CLR гарантирует, что память в стеке будет очищена? В этом докладе мы обсудим процесс преобразования C# кода в машинный код и то, как это связано с управлением памятью в стеке. Увидим разные трюки, которые JIT-компилятор делает, чтобы код работал быстрее. Доклад будет интересен тем, кто хочет знать, что скрывается под капотом привычных вещей и предпочитает понимать, как в деталях работает его код.

Formation

Compilation flow
var hello = "Hello";
var world = "World";
Console.WriteLine(hello + world);
ldstr "Hello"
ldstr "World"
call System.String::Concat
call System.Console::WriteLine
movabs rdi, 0x196af5078
mov rdi, qword ptr [rdi]
movabs rsi, 0x196af5080
mov rsi, qword ptr [rsi]
call 0x10d5ad380
mov rdi, rax
call 0x10dbb1d40

Notation types
• Infix
• Suffix
• Postfix
2 + 3
+ 2 3
2 3 +

Notation types
• Infix
• Suffix
• Postfix
builder.Append("Hello!")
Append builder "Hello!"
builder "Hello!" Append

2 2
3
4
3
2 2
12
14
2 + 3 * 4
Stack machine
Stack
head

Stack machine
C#
var i = 2 + 2;
2 2 + i;
Forth

Stack machine
var phone = GetPhoneNumber();
SendMessage(phone);
MakeCall(phone);
C#
call Contact GetPhoneNumber()
dup
call void SendMessage(Contact)
call void MakeCall(Contact)
CIL

Stack machine
var phone = GetPhoneNumber();
SendMessage(phone);
MakeCall(phone);
call Contact GetPhoneNumber()
dup
call void SendMessage(Contact)
call void MakeCall(Contact)
C# CIL
Stack phone
top

Stack machine
var mode = Mode.Default
var phone = GetPhoneNumber();
SendMessage(phone);
MakeCall(phone, mode);
C#
ldc.i4.1
stloc.0
call Contact GetPhoneNumber()
stloc.1
ldloc.1
call void SendMessage(Contact)
ldloc.1
ldloc.0
call void MakeCall(Contact, valuetype Mode)
CIL

Stack machine
var mode = Mode.Default
var phone = GetPhoneNumber();
SendMessage(phone);
MakeCall(phone, mode);
ldc.i4.1
stloc.0
call Contact GetPhoneNumber()
stloc.1
ldloc.1
call void SendMessage(Contact)
ldloc.1
ldloc.0
call void MakeCall(Contact, valuetype Mode)
C# CIL
Stack 1
top

JIT compiler
LdVar Sorting
& Tree
Ordering
Loop
Optimizations
Range Check
Elimination
Rationalization
Importer Inliner Morph
Flowgraph
Analysis
EmitterLowering LSRA CodeGen
Rationalized
LIR
Native
Code
GenTrees IR with reference counts
& evaluation order
Instr
Descs
Real
registers
Reg
Reqts
GenTrees
(IR)
IL
(bytecode)
Copy
Propagation
CSE
Assertion
Propagation
Loop
Optimizations
Range Check
Elimination
Copy
Propagation
CSE
Assertion
Propagation

JIT optimizations
• Not saving variables
• Method call inlining
• Range check elimination
• Jump instead of call
• …

.NET Internals
stack memory management
Nikolay Balakin
nikolay@balakin.me

Contenu connexe

Tendances

Every program needs some input and some logic to translate such input into structured data in memory. Language parsers, in particular, are notoriously error-prone to write,so programmers often define a high-level grammar and use parsergenerators to make the parsing process easier. What does this entail for a security analyst? In this talk you will learn what to do when you encounter GNU bison-generated code in a binary, what kind of code it creates, and how to exploit its structure to analyze targets faster and improve your fuzzers in the process. You will also walk away with a free (as in freedom) tool to automate your reverse engineering efforts.

[CB20] Reflex: you give me a parser, I give you a token generator by Paolo Mo...

CODE BLUE

Solr @ Etsy - Apache Lucene Eurocon

Giovanni Fernandez-Kincade

Protecting C++

Pavel Filonov

Ruby: OOP, metaprogramming, blocks, iterators, mix-ins, duck typing. Code style

Anton Shemerey

Cisco network equipment has always been an attractive attack target due to its prevalence and the key role that it plays in network structure and security. This equipment is based on a wide variety of OS (firmware) architectures, types, and versions, so it is much harder to develop a universal shellcode. Publicly available Cisco IOS shellcodes are tailored to specific equipment, have narrow functionality, and are not exactly useful for penetration testing. This talk is the presentation of a research initiated by our research center to create a shellcode which is as easily portable between different IOS firmwares as possible and which provides a lot of pentesting features because it can dynamically change the shellcode destination at the stage of post-exploitation. We will also consider the possibility of creating a worm which could spread across the infrastructure, from firewall to router, from router to switch, etc.

Cisco IOS shellcode: All-in-one

DefconRussia

Having Fun Programming!

Aaron Patterson

Rust LDN 24 7 19 Oxidising the Command Line

Matt Provost

Learning go for perl programmers

Fred Moyer

iCloud keychain

Alexey Troshichev

DConf 2016 std.database (a proposed interface & implementation)

cruisercoder

ClojurianからみたElixir

Kent Ohashi

An Intro to Python in 30 minutes

Sumit Raj

The Stack and Buffer Overflows

UTD Computer Security Group

Tendances (13)

[CB20] Reflex: you give me a parser, I give you a token generator by Paolo Mo...

Solr @ Etsy - Apache Lucene Eurocon

Protecting C++

Ruby: OOP, metaprogramming, blocks, iterators, mix-ins, duck typing. Code style

Cisco IOS shellcode: All-in-one

Having Fun Programming!

Rust LDN 24 7 19 Oxidising the Command Line

Learning go for perl programmers

iCloud keychain

DConf 2016 std.database (a proposed interface & implementation)

ClojurianからみたElixir

An Intro to Python in 30 minutes

The Stack and Buffer Overflows

Similaire à .NET Fest 2018. Николай Балакин. .NET Internals: управление памятью в стеке

The .NET architecture addresses an important need - language interoperability. Instead of generating native code that is specific to one platform, programming languages generate code in CIL (Common Intermediate Language) targeting the Common Language Runtime (CLR) to reap the rich benefits provided by the .NET platform. Advanced programmers occasionally peek into CIL code when they are in doubt about what is happening under the hood (using the Ildasm tool for .NET or monodis tool for Mono). Therefore, it is essential that developers working in .NET platform understand the essentials of CIL. This presentation uses an example driven approach to help understand bytecodes in CIL.

Common Intermediate Language (.NET) by Example

Ganesh Samarthyam

Kotlin / Android Update

Garth Gilmour

.NET Foundation, Future of .NET and C#

Bertrand Le Roy

[C++ Korea] Effective Modern C++ Study, Item 11 - 13

Chris Ohk

Your codebase sucks! and how to fix it

Llewellyn Falco

0x01 - Breaking into Linux VMs for Fun and Profit.pdf

scribdsituation719

JavaOne 2012 - JVM JIT for Dummies

Charles Nutter

0x01 - Breaking into Linux VMs for Fun and Profit

Russell Sanford

Linux has this great tool called strace, on OSX there’s a tool called dtruss - based on dtrace. Dtruss is great in functionality, it gives pretty much everything you need. It is just not as nice to use as strace. However, on Linux there is also ltrace for library tracing. That is arguably more useful because you can see much more granular application activity. Unfortunately, there isn’t such a tool on OSX. So, I decided to make one - albeit a simpler version for now. I called it objc_trace.

NYU hacknight, april 6, 2016

Mikhail Sosonkin

JavaScriptCore (JSC) is the multi-tiered JavaScript virtual machine in WebKit. The bytecode is a central piece in JSC: it’s executed by the interpreter and the source of truth for all of JSC’s compilers. In this talk we’ll look at the recent redesign of our bytecode format, which cut its size in half and enabled persisting the bytecode on disk without impacting the overall performance of the system.

A compact bytecode format for JavaScriptCore

Tadeu Zagallo

C Programming Training in Ambala ! Batra Computer Centre

jatin batra

DEF CON 27 - XILING GONG PETER PI - exploiting qualcom wlan and modem over th...

Felipe Prado

For years we’ve been told that the JVM’s amazing optimizers can take your running code and make it “fast” or “as fast as C++” or “as fast as C”…or sometimes “faster than C”. And yet we don’t often see this happen in practice, due in large part to (good and bad) development patterns that have taken hold in the Java world. In this talk, we’ll explore the main reasons why Java code rarely runs as fast as C or C++ and how you can write really bad Java code that the JVM will do a better job of optimizing. We’ll take some popular microbenchmarks and burn them to the ground, monitoring JIT logs and assembly dumps along the way.

Fast as C: How to Write Really Terrible Java

Charles Nutter

Python's "batteries included" philosophy means that it comes with an astonishing amount of great stuff. On top of that, there's a vibrant world of third-party libraries that help make Python even more wonderful. We'll go on a breezy, example-filled tour through some of my favorites, from treasures in the standard library to great third-party packages that I don't think I could live without, and we'll touch on some of the fuzzier aspects of the Python culture that make it such a joy to be part of.

A Few of My Favorite (Python) Things

Michael Pirnat

Clean Code Development

Peter Gfader

ECSE 221 - Introduction to Computer Engineering - Tutorial 1 - Muhammad Ehtas...

Muhammad Ulhaque

การเขียนโปรแกรมด้วยภาษา C

C Omputer R Oom

การเขียนโปรแกรมด้วยภาษา C

C Omputer R Oom

การเขียนโปรแกรมด้วยภาษา C

C Omputer R Oom

การเขียนโปรแกรมด้วยภาษา C

C Omputer R Oom

Similaire à .NET Fest 2018. Николай Балакин. .NET Internals: управление памятью в стеке (20)

Common Intermediate Language (.NET) by Example

Kotlin / Android Update

.NET Foundation, Future of .NET and C#

[C++ Korea] Effective Modern C++ Study, Item 11 - 13

Your codebase sucks! and how to fix it

0x01 - Breaking into Linux VMs for Fun and Profit.pdf

JavaOne 2012 - JVM JIT for Dummies

0x01 - Breaking into Linux VMs for Fun and Profit

NYU hacknight, april 6, 2016

A compact bytecode format for JavaScriptCore

C Programming Training in Ambala ! Batra Computer Centre

DEF CON 27 - XILING GONG PETER PI - exploiting qualcom wlan and modem over th...

Fast as C: How to Write Really Terrible Java

A Few of My Favorite (Python) Things

Clean Code Development

ECSE 221 - Introduction to Computer Engineering - Tutorial 1 - Muhammad Ehtas...

การเขียนโปรแกรมด้วยภาษา C

Plus de NETFest

Что делать, если все, что можно уже закэшировано, а код всё ещё тормозит? В этом докладе мы обсудим, как работают некоторые низкоуровневые механизмы .NET и как мы с их помощью можем выиграть драгоценные секунды, когда счет идет на отдельные такты процессора.

.NET Fest 2019. Николай Балакин. Микрооптимизации в мире .NET

NETFest

The move to microservice infrastructure exposes new challenges, that are not typical for classic monolithic applications. Deployment, security, monitoring -- this list is far from complete. In this talk Serhiy will speak about how to establish a fast and reliable communication channels between microservices. What patterns, protocols and data formats are available. How to enforce a backwards compatibility and strict contract between services and their clients. When we should use sync or async communication style, and so on. Come to this session and hopefully you will come out with new ideas of how to build your stuff even better.

.NET Fest 2019. Сергей Калинец. Efficient Microservice Communication with .NE...

NETFest

В сентябре 2019 года выходит новая версия .NET Core 3. Я расскажу о преимуществах .NET Core перед .NET Framework, о том, что нового становится доступным в последней версии .NET Core и о планах Майкрософт по поводу будущего всех .NET фреймворков.

.NET Fest 2019. Оля Гавриш. .NET Core 3.0 и будущее .NET

NETFest

А Вы знали, что практически для каждого проекта можно применить машинное обучение? И теперь для этого не нужно изучать новый язык программирования (как Python или R) и осваивать численные методы. В этом докладе я расскажу об основах машинного обучения и о том, как легко начать использовать его в своих .NET проектах с помощью ML.NET и других решений от Microsoft.

.NET Fest 2019. Оля Гавриш. Машинное обучение для .NET программистов

NETFest

In these days, automation is the key to reduce the effort in governing complex system. Also, it reduces mistakes of manual, repetetive, operations. Despite the standardization of common approaches using text-based Infrastructure-as-code definitions, as YAML or JSON, I will suggest to write your provisioning templates using C# and .NET, against Microsoft Azure. In this demo-only session, we'll see the Azure Fluent Management Libraries in action to create a multi-tenant environment with strong-typed objects and compile-type-safe provisioning code.

.NET Fest 2019. Roberto Freato. Provisioning Azure PaaS fluently with Managem...

NETFest

“Domain Driven Design is an approach to software development for complex needs by connecting the implementation to an evolving model.” While there are many resources on the web about the DDD, they are generally theoretical rather than useful practical guides. One reason is that a DDD implementation quite varies depending on your domain and culture. However, it is still possible to provide some explicit rules those can help you while designing your code base. This talk starts by introducing the DDD and providing a layering model based on the DDD and the Clean Architecture. It then introduces the core building of an application built on the DDD principles. In the second part of the talk, it shows some strict coding rules for the core building blocks with real code examples and suggestions. These rules are essential to build a large scale application implements DDD patterns & practices. While the solution structure and code samples are based on .NET and C#, the talk is useful for developers and architects working with any server side technology.

.NET Fest 2019. Halil Ibrahim Kalkan. Implementing Domain Driven Design

NETFest

Я розповім про еволюцію фіча тоглів у компанії та наш досвід їх використання. Пройдемось покроково в їх розвитку: Від файлу конфігурації зі звичайним kill-switch для ввімкнення меінтенансу, який вмикав/вимикав доступ до сервісів одразу всім користувачам. До гнучкої системи з набору правил з пріоритетами з гранулярністю від країни, штату до окремого користувача. Від редагування через базу даних до панелі адміністратора та автоматизованих змін залежно від подій в системі. А також розповім про actions - комбінацію фіча тоглів та правил бізнес-логіки для динамічного інтерфейсу клієнтів на основі доступних дій користувачу.

.NET Fest 2019. Сергій Бута. Feature Toggles: Dynamic Configuration at Wirex

NETFest

GraphQL is a great way to expose your APIs and it has changed the way we think about consuming data over HTTP. With GraphQL we want to have one schema that provides all the data to us in a consistent way, enabling us to drill into the graph and fetch with one request what we actually want instead of having to issue multiple requests. In the real world, however, we more often build small services that serve certain use cases. Simpler services are easier to maintain and can be deployed more rapidly. Moreover, we often also want to use external services that are not built by us. Ultimately, we will end up with multiple APIs again. The solution for this dilemma is schema stitching. This talk will explore the schema stitching capabilities on ASP.Net Core with Hot Chocolate. We will show how you can set up a Hot Chocolate GraphQL gateway in under 5 minutes and move on to the various stitching scenarios. This talk introduces simple auto-stitching scenarios and goes on to demonstrate how you can rewrite your GraphQL APIs into something truly new.

.NET Fest 2019. Michael Staib. Hot Chocolate: GraphQL Schema Stitching with A...

NETFest

В этом выступлении Андрей расскажет о внутренностях базового сервиса, написанного с использованием паттерна CQS, который обрабатывает входящие запросы команд и публикует события, описывающие переходы состояния системы. После этого он опишет общие способы тестирования такого сервиса и объяснит плюсы и минусы существующих подходов. Затем он расскажет про AutoFixture и покажет, как она может сделать тесты намного чище, а конфигурацию - более удобной, путем инъекции параметров в метод теста, объяснит существующие проблемы с инициализацией и очистке данных в асинхронных тестах и покажет, как с этим справляться с помощью некоторой легковесной интеграции между xUnit и AutoFixture.

.NET Fest 2019. Андрей Литвинов. Async lifetime tests with xUnit and AutoFixture

NETFest

.NET Fest 2019. Анатолий Колесник. Love, Death & F# Tests

NETFest

Все когда-либо писали парсеры, но многие так и не знают как спарсить HTML без регулярных выражений. Очень длительное время концепция парсинга языков с рекурсивной грамматикой для меня была черной магией, а люди которые занимаются разработкой компиляторов и предметно-ориентированных языков вовсе казались волшебниками. Но это оказалось не так и сложно. В моем докладе я хочу вам рассказать о том что такое парсеры в целом, зачем они нужны и какие они бывают, а самое главное -- покажу как перейти от традиционных методик их написания к более удобному и понятному функциональному способу. В ходе презентации мы также напишем рабочий JSON парсер в качестве proof of concept.

.NET Fest 2019. Алексей Голуб. Монадные парсер-комбинаторы в C# (простой спос...

NETFest

Believing it is the most powerful PaaS service of the entire public cloud, I will share with you all the most interesting features of App Service and the good tips from the field, to see how to properly use it in production and focus on applications, instead of governance. I will dig into the architecture, the deployment options, the runtimes, the secrets management, logging and troubleshooting and into some advanced high-scale scenarios. If you never used this, you will say ""ok, how did I survive without it?"".

.NET Fest 2019. Roberto Freato. Azure App Service deep dive

NETFest

Во время доклада, я поделюсь с Вами опытом, который мы получили, используя микросервисы в прод K8S кластере. Также, обозначу основные проблемы, с которыми столкнулась наша команда на этапе их диагностики. И, самое главное - что мы сделали чтобы избежать их в будущем. Отвечу на вопросы: Почему мы мигрировали в облако? Почему dotNet Core 2.2 вызвал кучу проблем? Данный доклад сохранит сотни часов вашим разработчикам и DevOps команде, жизнь которой может напоминать кошмар.

.NET Fest 2019. Леонид Молотиевский. DotNet Core in production

NETFest

The majority of companies are struggling with an issue of growth where they started from handful group of people and reached 1000+ employees. In case of small groups the relationships remind family’s connections so everyone knows each other personally and the atmosphere is warm and charm whereas starting from 500+ to 1k keep it as family is tough and most of the companies come up with processes on one hand and culture on other. There ain’t no silver bullet how to manage it and in the end of the day they are balancing working a lot about good atmosphere in company and setting up relationships between teams. The issue isn’t new however tools and approaches evolved a lot this is where .NET Core and ML.Net comes in handy. These days AI/ML take over the world and bots as one of implementations are already a part of our life therefore our entuthiastic team created a bot using latest .NET Bot Framework v4 who helps managers to “measure” atmosphere in teams and crucial to socialize teams leveraging the power of ML.NET.

.NET Fest 2019. Александр Демчук. How to measure relationships within the Com...

NETFest

In this session we'll demonstrate how to bring dragons or any other 3D model to life using Microsoft's Azure Spatial Anchors, HoloLens and mobile phones. You will learn what is augmented reality, we will introduce you Hololens, we will teach you what is Azure Spatial Anchor, how they work and how you can use them in your apps. This cross-device experience might be usable for all kind of applications.

.NET Fest 2019. Anna Melashkina та Philipp Bauknecht. Dragons in a Mixed Real...

NETFest

You must have noticed how Docker and containers is playing a more and more important part in .NET development. Docker support is everywhere, so it should be easy to build solutions based on container technology, right? But, it takes a bit more to architect and create a .NET solution that use Docker at its core. Many questions arise: How do you design a solution architecture that fits well with containers? Would I use .NET or .NET Core? What is a proper way to migrate to such an architecture? What changes in the .NET implementation from pre-Docker solutions with micro-services? Where do container orchestrators fit in and how do I build and deploy my solutions on a Docker container cluster, such as Azure Kubernetes Service? These and many other questions will be answered in this session. You will learn how to design and architect your .NET solutions and get a flying start to create, build and run Docker-based containerized applications.

.NET Fest 2019. Alex Thissen. Architecting .NET solutions in a Docker ecosystem

NETFest

Serverless technology is trending, but in-depth details are missing. How does it fit with non-serverless components? What are the practical use cases? Should you fight vendor lock-in? And what about limits and pitfalls with Azure? I will answer those questions, share a few tricks and short demo. I'll cover serverless usage scenarios with Azure, what problems can be solved, and what is a viable adoption strategy. Then I'm going to talk about technology shortcomings, when to omit it and how to rip all benefits. There are circumstances when a cloud-agnostic approach is beneficial, so I discuss serverless frameworks too and why vendor lock is not that bad. Finally, we'll look at a short demo that illustrates why you have to use specific serverless patterns.

.NET Fest 2019. Stas Lebedenko. Practical serverless use cases in Azure with ...

NETFest

Do you recall those buzz words like TDD, BDD? Yep, but we know their problems as well! TDD is too granular. BDD is too coarse-grained. Unit tests are too chatty. BDD is too abstract. TDD requires knowledge of implementation details. BDD does not care about implementation at all. What is in the middle? Integration tests. Let's be Integration driven then! OK, then how to build infrastructure to run Integration tests? Should we start with IaaS first? How to speed up the development and take into account non-foundational requirements like scaling, security borders, isolation, etc. from the very beginning? To answer the questions, we would combine Integration test-based development with serverless (AWS) to solve a typical business task. Based on the example, we would show how to create a solid foundation for further refactoring/refining of the overall solution and concreting it with Unit tests. Acceptance tests would be left for home exercise ;)

.NET Fest 2019. Сергей Медведев. How serverless makes Integration TDD a reali...

NETFest

Задачи по обработке естественного языка сейчас встречаются практически в любом проекте. К сожалению, до недавнего времени, платформа .NET не сильно подходила для решения подобных задач. С выходом ML.NET ситуация стала меняться к лучшему, но все еще далека от идеала. На этом докладе я расскажу про основные задачи, которые решаются методами Natural Language Processing и какие существуют способы решения этих задач на платформе .NET (сервисы, библиотеки, фреймворки).

.NET Fest 2019. Сергей Корж. Natural Language Processing in .NET

NETFest

A Public Key Infrastructure (PKI) is the basis of modern system authentication; X.509 certificates are at the core of modern cryptography. Building your own PKI is not for the faint of heart, so we usually buy our certificates from an external Certificate Authority or operate a 3rd-party off-the-shelf PKI. But what can you do if you need to issue your own certificates while keeping your costs low? What if, for example, you're in the business of manufacturing millions of IoT devices and you need to issue a certificate to each and every one of them? And to top it off - you want to do it in a Serverless manner? Join me in this session, as we build a Serverless PKI system with Azure Functions & Key-Vault and learn all about Key-Vault's capabilities in regards to X.509 certificates along the way.

.NET Fest 2019. Eran Stiller. Create Your Own Serverless PKI with .NET & Azur...

NETFest

Plus de NETFest (20)