Signed up for a 10 day trial of O'Reilly to read the first 5 chapters of Delta Lake: Up and Running which actually seems to talk about the various processing tables etc and that the gold layer may actually be constructed in a star schema, details lacking everywhere else. Did a few more videos on Module 2 of the Databrick Engineer V3 course before they took it offline for maintenance, without any warning. Bit off. Signed up for the Community Edition of Databricks – seems the cluster twice as powerful as the one I've been using, so good for tutorials and such like, though the interface seems a bit outdated.
Upgraded WriteFreely from v13.0.1 to v13.0.2. Upgraded infuerno.github.io jekyll pages to the latest version.
Watched the first module from Data Engineering with Databricks V3. Bit concerned that the more interesting part was in the V2 course – everything seems to be going Delta Live Tables now. Fine as long as it doesn't mean the cluster has to be constantly up. The advanced course appears to cover everything in the old V2 in more detail, so need to get onto that ASAP.
Recently I've been reading a lot about data warehouses and data lakes. I've been rather loosing track, and had forgotten about this space a bit. Was getting a 502 nginx error, but after checking the logs – at /var/log/nginx – discovered it was simply the writefreely service which wasn't running. Restarted and voila. Ran apt upgrade etc. Moved the last of my domains from gandi to porkbun. Renewed a certificate for frny.uk – seemed successful, but not showing correctly yet, so will have to see.
Downloaded O'Reilly book about delta lake. In the “to read” pile.
Continued putting together a new react project to create a wordle clone which would allow playing all the old ones.
Created empty npm project. Added prettier, eslint and parcel. Added typescript, but disable setting to enforce (while I'm a little bit hazy on how best I need to do this). Added styled components and copied a (non typescript) Wes Bos style set up.
Got the header working with flex box and some icons using react-icons.
$ git log --pretty=format:"%h %ad %s" --date=rfc
e8cca8d Wed, 9 Feb 2022 23:21:15 +0000 Style header
10127f5 Wed, 9 Feb 2022 21:50:35 +0000 Add base components
01b9af3 Wed, 9 Feb 2022 20:47:11 +0000 Configure for typescript
00f6b9c Wed, 9 Feb 2022 20:01:09 +0000 Initial setup with prettier and eslint
Going down a bit of a wormhole with messages and events and now reactive architectures. Started reading the reactive manifesto, still a bit confused between the difference between event-driven architectures and message-driven architectures. Can you design a system which achieves the same goals, but using two different approaches OR are these two different approaches used in different situations?
Found a useful course from lightbend / akka introducing reactive architectures.
Listened to a random Coding Blocks podcast this morning about APIs.
Bit of a mish mash of a day. Found some useful articles re Azure Service Bus (and messaging in general) which I need to read properly. Also started on a Pluralsight course on containers in Azure. Configured pipenv for running python locally and wrote it up.
Async await can be achieved using generators, by ensuring that the last part of the method which completes the async functionality calls it.next(). However, there NEEDS to be some asynchronous part in here e.g. the fetch().then(). As soon as that async part gets hit, the yield returns undefined and that part of the calling function pauses. Then the Ajax call returns to the then(), which calls it.next(value) and the calling code resumes by sending out value (to e.g. an awaiting variable).
Also then started watching the latest hard parts course on Frontend Masters from Will Sentence. Completed the Introduction – recap on thread of execution / memory / call stack. Need to understand the event loop, plus generators and iterators in much more depth.
Continued with Wes Bos' ES6 for Everyone course, bought in the Black Friday sale last year and just picked up again earlier this month after doing the first 4 or so modules last year. Some parts are a bit outdated, but generally relevant and is filling in some gaps.
Completed module 15 on Classes.
But what about snickers.eat? What does he like to eat? Plastic we find on the ground. Sounds good.