Monday, 6 January 2025

Where did my time go in 2024? Sharing my 2024 Personametry results.

It's that time of year again to share my time tracking analysis for 2024. The visuals should be self explanatory and nothing surprising. 2024 was the year my professional work stream dominated, but not completely. I did also index on spending more time with family (at the expense of 1:1 time as a husband), and also spent much time on my own "me time" primarily focused on experimenting with AI tools. I maintained previous levels of spiritual hours, back to 2022 norms since 2023 was an outlier (pilgrimage to Makkah was the highlight of 2023). My health and fitness took a severe knock and is on a downwards trend since 2021. 2021 was the year I made big changes impacting personal and professional streams: Relocated to a new city (Cape Town) leaving friends and family behind in Johannesburg, starting a new job in a new company in a new domain -- I'm now four years into this transition, and I'm not pleased with the downwards trends in my personal streams. 2025 will need to be a year of intentional change in managing my work time, setting firmer boundaries, and finding a solution to working late nights, weekends, and limiting the streaks of long work hours. 2024 reached the peak in my work hours since starting time tracking in 2016, that's almost 10 years of time tracking! In the last four years, since starting my new job in 2021, the work hours are trending upwards (in 2022 I made adjustments to reduce work hours with some success), only to rebound higher in 2023, and much higher in 2024. In a future post, I will share the challenges of working for  a global high-tech giant like Amazon AWS from South Africa and the impact on personal time - it has been, and continues to be, the biggest challenge in maintaining my professional "happiness", especially when it comes to maintaining a regular "start day" and "end day" routines and rituals.

Overview since 2018
Here's the summary dashboard of my time spent in my personas since 2018:


What's my workflow for tracking all this data?
Nothing much has changed since I started my experiment back in 2016. I use Harvest for tracking my personal and professional streams. I use a free account, with one major project called "RAGE Time tracking". Tasks are related to my personas. I track my time from the minute I wake up till I go to sleep. Throughout the day, I switch between tasks, making sure I don't track my personal time as work time, including lunch breaks. The hours logged do track closely to 24 hours/day, for the whole year, with a negligible margin of error that's within reasonable tolerance (I'm still human!). The idea is to regularly inspect where my time is being spent, and make adjustments according to my prioritized streams. 2024 unfortunately wasn't my best year in reaching a harmony-state, something I'm not pleased about. The data helps me make sense of how my life is transforming, triggering moments of reflection for adapting or at times, just general acceptance of my current reality, it is what it is -- forcing me to make sense of my aspirations to perhaps re-calibrate (for areas where I have full agency to control and influence).

How has my workflow for insights generation changed over time - are genAI tools of any help?
In the early years, I used Excel as my main source of data insights. Later I moved over to Amazon QuickSight. I still use QuickSight to generate my analysis and dashboards, as I have a few transformations with calculated fields. I then export the Quicksight data tables as Excel file as the source data set for AI tools. Quicksight too, is a little quirky with ingesting new data, maintaining the integrity of calculated fields and sometimes data gets corrupted when updating its splice models. I spent a good few hours debugging failures in data alignment, missing rows due to errors in calculated fields (that should have "just worked").  I use a free account, so I'm unable to use any of the AI "Amazon Q" features - ideally, I'm expecting an interactive analysis/dashboard AI assistant that I can have a conversation with. Alas, there is no way to share or embed QuickSight dashboards openly, embedding QuickSight dashboards in blog posts would be cool.

Anyway, with the advent of ChatGPT, in the last two years, I started integrating AI data analysis. I spent the last few days with ChatGPT - suffice it to say, I'm not that impressed by ChatGPT's Data Analyst capability. Nothing much has improved since the last year. At least it can understand large datasets in Excel or CSV format which is cool, something that Claude, Gemini or NotebookLM don't currently support. 

ChatGPT's "Data Analyst" does a decent job performing exploratory data analysis, was able to infer what my dataset was largely about without me providing clues or guiding info. The biggest problem I encountered was loss of context, loss of memory, and complete loss of the data's runtime environment. I had to repeatedly reload the dataset because ChatGPT "lost the data", then re-coax it to understand the data fields. It also hallucinated and made simple mistakes calculating aggregated results. It got simple math wrong. At times, I had to specify in detail how to use the data fields to generate the insights I asked for. This was surprising as I had a much better experience on the model from a year ago. I'm using the latest 4o model, being a ChatGPT Plus subscriber. I feel that OpenAI team should just kill the Data Analyst as a separate feature and promote the Canvas Projects capability going forward.

On ditching the built-in "Data Analyst", I switched to the latest Projects capability in ChatGPT. I shared my dataset as project files, included all my blog posts on Personametry and RAGE as context data, and provided fine tuned instructions for the project as data scientist responsible for producing business intelligence reporting. I had a much much better experience using ChatGPT projects than Data Analyst - however - I still ran into issues with hallucination, over confidence in the AI's interpretation of data and calculated results. AI is still far from being a trusted source of business intelligence as far as I'm concerned. You need to take time to manually build your own reports and analysis, like the way I use Quicksight -- and then test the AI generates the same results. I've spent hours on this over the last few days - yes, it was a little frustrating - but nevertheless insightful. The more time I spend playing around with these tools, the more I am amazed at the potential power and future disruption in this space - and at the same time, the more I gain some comfort that there is still a long journey ahead. For my simple data set of hours logged by task, the AI doesn't perform 100% on first shot -- so for big businesses out there, don't go firing your business analysts, BI engineers anytime soon, thinking GenAI will replace these roles... IMHO, we are at least another 2 years away from maturing, if not, more. A key input is validation - you would need to generate reference test cases to validate all the metrics compute correctly to gain trust in AI-generated insights.

In 2023 I had some fun with Noteable's ChatGPT plug-in. I was really looking forward to Noteable's progress in the area of AI-assisted data intelligence, but alas, the company and product is no more. I'm now experimenting with something similar from deepnote, but it's early days - and also quite expensive for a general hobbyist as myself. I believe this is the future though.

Where do I see this experiment going?
Personal AI assistants are all the rage these days, some say 2025 is the year of AI agents. I'd like to build a truly personalized agent that is not just about rudimentary calendar integration, answering texts and emails - but an assistant that truly understands me as a person - across my personal and professional streams. Integrating my time tracking data, health, fitness and well-being data from smart trackers, integrated with my todo lists, etc. Coming back to personametry, I would like daily, weekly insights from my personal assistant. Imagine if we could have an assistant that says "Mo, I noticed you haven't exercised in awhile, and you're finishing work quite late. You've not had quality time with your wife and kids - and your recent trip to the ER is not boding well. I've booked dinner for you and the family at your favorite restaurant, and for the upcoming long weekend, I've made a booking at mountain lodge you will enjoy. I scanned your calendar, there's no major work deliverables or travel planned - so take some time to rest and recharge, or else you will burnout soon!"

So, what's the 2024 insights then?
Until I can get my personal agent implemented, manual Google slides will have to do. Check it out below!