Plone server
•
3 j'aime•1,619 vues
Plone Conference 2016 talk in Boston. Plone server is an experimental server that supports plone.restapi and is based on python 3.5 asyncio
Recommandé
Contenu connexe
Tendances
Tendances (19)
En vedette
En vedette (20)
Similaire à Plone server
Similaire à Plone server (20)
Plus de Ramon Navarro
Plus de Ramon Navarro (12)
Dernier
Dernier (20)
Plone server
- 1. Plone Server Experimental ? Fun !
- 2. Ramon Navarro Bosch CATALAN we do things because we don’t know it was impossible CTO iskra.cat CTO intranetum.com FWT plone.org
- 4. so why ?
- 6. Great talks
- 7. Plone 2020
- 8. Martin DX et al. Really great component design
- 9. Timo Quality Plone Rest API
- 10. Asko Hero Async + Low level
- 11. Nathan 4WD Elastic Search - Front End NG2
- 12. Eric Front Front End NG 2
- 13. Barcelona SPRINT 2016 15 DEVS on BACK + API + FRONT
- 17. THEMING PAS API JS/CSS CATALOG API DX GENERIC SETUP MULTI LINGUAL LINK INTEGRITY ZOPE2 AC CMF ACQUISIT. ZODB VERSION LOCKING BEHAVIOR Z3CFORM FORMLIB ZPT ZTK CONTENT RULES VIEWLETS PORTLETS WORK FLOWS QUERY STRING REGISTRY TTW RESTRICT PYTHON UPGRADE DISCUSS CONTENT TYPES UUID ITERATE OPENID CACHING TILES MOSAIC REST API PAS PLUGINS CATALOG IMPLEMEN FW API FW API SERVER greatest common divisor CORE frontend PloneCMS TILES
- 18. THEMING PAS API JS/CSS CATALOG API DX GENERIC SETUP MULTI LINGUAL LINK INTEGRITY ZOPE2 AC CMF ACQUISIT. ZODB VERSION LOCKING BEHAVIOR Z3CFORM FORMLIB ZPT ZTK CONTENT RULES VIEWLETS PORTLETS WORK FLOWS QUERY STRING REGISTRY TTW RESTRICT PYTHON UPGRADE DISCUSS CONTENT TYPES UUID ITERATE OPENID CACHING TILES MOSAIC REST API PAS PLUGINS CATALOG IMPLEMEN FW API FW API SERVER greatest common divisor CORE frontend PloneCMS TILES
- 19. THEMING PAS API JS/CSS CATALOG API DX GENERIC SETUP MULTI LINGUAL LINK INTEGRITY ZOPE2 AC CMF ACQUISIT. ZODB VERSION LOCKING BEHAVIOR Z3CFORM FORMLIB ZPT ZTK CONTENT RULES VIEWLETS PORTLETS WORK FLOWS QUERY STRING REGISTRY TTW RESTRICT PYTHON UPGRADE DISCUSS CONTENT TYPES UUID ITERATE OPENID CACHING TILES MOSAIC REST API PAS PLUGINS CATALOG IMPLEMEN FW API FW API SERVER greatest common divisor CORE frontend PloneCMS TILES
- 20. THEMING PAS API JS/CSS CATALOG API DX GENERIC SETUP MULTI LINGUAL LINK INTEGRITY ZOPE2 AC CMF ACQUISIT. ZODB VERSION LOCKING BEHAVIOR Z3CFORM FORMLIB ZPT ZTK CONTENT RULES VIEWLETS PORTLETS WORK FLOWS QUERY STRING REGISTRY TTW RESTRICT PYTHON UPGRADE DISCUSS CONTENT TYPES UUID ITERATE OPENID CACHING TILES MOSAIC REST API PAS PLUGINS CATALOG IMPLEMEN FW API FW API SERVER greatest common divisor CORE frontend PloneCMS TILES
- 21. THEMING PAS API JS/CSS CATALOG API DX GENERIC SETUP MULTI LINGUAL LINK INTEGRITY ZOPE2 AC CMF ACQUISIT. ZODB VERSION LOCKING BEHAVIOR Z3CFORM FORMLIB ZPT ZTK CONTENT RULES VIEWLETS PORTLETS WORK FLOWS QUERY STRING REGISTRY TTW RESTRICT PYTHON UPGRADE DISCUSS CONTENT TYPES UUID ITERATE OPENID CACHING TILES MOSAIC REST API PAS PLUGINS CATALOG IMPLEMEN FW API FW API SERVER greatest common divisor CORE frontend PloneCMS TILES
- 23. we need it at work (intranetum.com) Performance problems on write operations and async integration, lots of docker containers
- 24. Collecting all ideas, opinions of paining zope/plone “features” and simplify
- 25. Why don’t use all the GOOD parts and ADAPT them to create a REST CMS API FWT for a SIMPLER PLONE backend ? Simploneity
- 26. one way to do something
- 27. Non Opinionated
- 29. An async app server that offers a traversable REST API with a ZODB
- 30. And we can build a CMS on top of it
- 31. Headless CMS • NOT included : The view part! • Included : Strong flexible API • Included : DB/Persistance • Included : CRUD and Management ?
- 32. Content Type • NO CMF • zope.container and dx • 1 content rule them all: container (Item)
- 33. Definition of content type • Definition of Generic Content types global • Content type defined in code with directives: • catalog/index • read/write • primary
- 34. Definition of content type class IDocument(IItem): catalog(title='text') title = schema.TextLine( title=_('Títle'), required=False) <plone:contenttype portal_type="Todo" schema=".todo.ITodo" class=".todo.Todo" behaviors=".todo.IDublinCore" />
- 35. plone.jsonserializer • Used on plone.app.mosaic • Need to merge with plone.restapi • Serializes and deserializes DX content and types to JSON
- 36. plone.registry • Main/unique configuration place • All persistent info in one place
- 37. API DEFINITION • TRAVERSAL -> JSON • FRAMING • Websocket API • PLONE REST API (BASE on plone.server)
- 38. API DEFINITION "plone.server.interfaces.IPloneSite": { "endpoints": { "@registry": { "GET": { "factory": "plone.server.api.registry.Read", "permission": "plone.ReadConfiguration" }, "PATCH": { … "DELETE": { "factory": "plone.server.api.portal.DefaultDELETE", "permission": "plone.DeletePortals" }
- 39. CORS • Defined by site on registry • One configuration for all the site
- 40. Mount DB / Sites • /DB/SITE/FOLDER/OBJ • ZEO / ZODB "databases": [ { "plone": { "storage": "ZODB", "folder": "data" }, "zeo1": { "storage": "ZEO", "address": "127.0.0.1", "port": 8090 } } ],
- 41. Traversal • Get the resource • User abstraction • Language negotiation • Check Access permission • View lookup • Traverse view • View security checker • Render lookup / content type negotiation • Transaction View execution • Render execution / Framing • CORS checks/headers
- 42. Traversal • READ CALLS • GET • HEAD • OPTIONS • WRITE CALLS • POST • PATCH • PUT • DELETE
- 43. Request • site_components (globalSiteManager) • site_settings (plone.registry) • app (rootApp) • site (plone site) • security (authenticated users) • resource (main object) • tail (queue of traversing after main object) • _db_id (id of db) • _site_id (id of site)
- 44. Helpers • subrequest : do a real request to API • do_traverse : do a traversal with security
- 45. Upload/Download • External BlobStorage with async (buffer and resumable) for upload and download • TUS support for client resumable upload
- 46. • Process configuration (APP configuration) in Root Object throw config JSON file (may REST API) • Registry configuration and local components (SITE configuration) throw REST API • Installation addons (old install.py) AddOns and config
- 47. Delegate to External • Define the interfaces and allow to have different implementations to get: • Users DB • Catalog
- 48. No Acquisition No Attribute Traverse • portal[‘folder1’][‘folder2’][‘item’] NO Generic Setup NO z3cform
- 49. Roles • plone.Owner • plone.Editor • plone.Reader • plone.Anonymous • plone.SiteAdmin • plone.SiteDeleter
- 50. Permissions • plone.AccessContent • plone.ModifyContent • plone.DeleteContent • plone.AddContent • plone.ViewContent • plone.AccessPreflight • plone.SeePermissions • plone.ChangePermissions • plone.ReindexContent • plone.AddPortal • plone.GetPortals • plone.DeletePortals • plone.MountDatabase • plone.GetDatabases • plone.UmountDatabase • plone.WriteConfiguration • plone.ReadConfiguration • plone.RegisterConfigurations • plone.ManageAddons
- 51. Packages • from 93 to 10 plone* • Lines of code (py): • Plone 5 : 881070 • plone* 129185 • P.S. : 222447 • plone* 13955 • plone.server • plone.dexterity • plone.registry • plone.supermodel • plone.uuid • plone.behavior • plone.alterego • plone.rfc822 • plone.jsonserializer • plone.i18n
- 55. plone.app.iterate plone.app.caching Products.CMFPlacefulWorkflow plone.app.upgrade ZODB5 zope.processlifetime zope.interface zope.component zope.structuredtext zope.location zope.i18nmessageid zope.i18n zope.dottedname zope.deprecation zope.deferredimport zope.container zope.cachedescriptors zope.app.locales z3c.autoinclude transaction plone.sessionplone.schema plone.registry plone.protect plone.outputfilters plone.memoize plone.locking plone.intelligenttext plone.indexer plone.i18n plone.contentrules plone.batching plone.app.vocabularies plone.app.locales plone.app.layout plone.app.customerize plone.app.contentrules plone.api Products.contentmigration Products.PortalTransforms Products.PluginRegistry Products.PlacelessTranslationService Products.MimetypesRegistry Products.MimetypesRegistry Products.GenericSetup Products.DCWorkflow Products.CMFEditions zc.lockfile Products.StandardCacheManagers Products.PythonScripts Products.MIMETools Products.MailHost Products.ExternalMethod zope.size zope.sequencesort zope.sendmail zope.security zope.schema zope.proxy zope.lifecycleevent zope.exceptions zope.contenttype zope.contentprovider zope.configuration zLOG zExceptions ZopeUndo RestrictedPython Record MultiMapping DocumentTemplateProducts.SecureMailHostzope.ramcache zope.ramcache plone.openid zope.annotation plone.supermodel plone.rfc822 plone.dexterity plone.behavior z3c.zcmlhook plone.cachepurging plone.caching Products.validation plone.uuid zope.datetime zope.broken zope.filerepresentation plone.keyring collective.monkeypatcher plone.transformchain zope.componentvocabulary plone.app.imaging plone.app.querystring plone.resource plone.app.relationfield z3c.relationfield plone.app.lockingbehavior plone.app.versioningbehavior plone.stringinterp Products.ZopeVersionControl zope.copy zope.app.publication plone.scale plone.synchronize plone.alterego zope.intid z3c.objpath collective.elephantvocabulary zope.error zope.authentication zope.keyreference zope.event zdaemon ZConfig persistent zc.relation Products.CMFDiffTool Products.ExternalEditor Products.PasswordResetTool
- 56. How transactions work? • 1 connection x thread • locking 1 transaction x request object • for each request cache updated
- 57. Async loop • Why you need async ?? • Async Tasks connected to ZODB
- 58. Async Queue await getUtility(IQueueUtility).add(viewOperation) Main Thread Transaction Executor Thread Queue Executor Thread Queue Executor Thread Queue Executor Thread ZEO Networking Thread
- 59. AioHTTP • FAST • SSL support • Custom router • Websockets support HTTP client/server for asyncio
- 60. Gunicorn compatible • WSGI • Workers: gunicorn my_app_module:my_web_app --bind localhost:8080 --worker-class aiohttp.worker.GunicornWebWorker --workers 6 • UVLoop: gunicorn my_app_module:my_web_app --bind localhost:8080 --worker-class aiohttp.worker.GunicornUVLoopWebWorker -- workers 6
- 61. Python >= 3.5
- 62. Testing • py.test + layers (gocept.pytestlayer) • coverage • Functional to API • WS and API wrappers / helpers
- 63. Some addons • users : pserver.oauth • catalog : pserver.elasticsearch • field : pserver.gcloudstorage • cms : pserver.cms
- 64. Performance • standalone (12t 100c) = 119% + ràpid • cluster 3 UC • GUnicorn UVLoop + 2 processos plone.server • Mean RO : 170% + ràpid
- 65. Performance
- 66. Performance
- 67. Performance
- 68. DEMO • https://github.com/pyrenees/pserver.demo.git • Content Type definition • API definition • Install • Configuration of a site
- 69. TODOS • Tests and integration of forked packages (9) • Lots of security audits • Blobs (ZODB implementation) • caching - memoize • Offline Migration • aiohttp.web -> aiohttp.server • user DB / catalog (ZODB implementation) • Join jsonserializer + restapi • plone.api • Workflow • Throw The API customization
- 70. Futures • Neo4J backend • GraphQL query interface • Create DB in a ZEO ?
- 71. Near future • REST API • PLONE_CLIENT
- 72. We are a community! We can have fun! We should be proud!
- 74. Who wants this “experiment” is named plone.server ?
- 75. Thanks !