Showing posts with label Quantified Self. Show all posts
Showing posts with label Quantified Self. Show all posts

Monday, 6 January 2025

Where did my time go in 2024? Sharing my 2024 Personametry results.

It's that time of year again to share my time tracking analysis for 2024. The visuals should be self explanatory and nothing surprising. 2024 was the year my professional work stream dominated, but not completely. I did also index on spending more time with family (at the expense of 1:1 time as a husband), and also spent much time on my own "me time" primarily focused on experimenting with AI tools. I maintained previous levels of spiritual hours, back to 2022 norms since 2023 was an outlier (pilgrimage to Makkah was the highlight of 2023). My health and fitness took a severe knock and is on a downwards trend since 2021. 2021 was the year I made big changes impacting personal and professional streams: Relocated to a new city (Cape Town) leaving friends and family behind in Johannesburg, starting a new job in a new company in a new domain -- I'm now four years into this transition, and I'm not pleased with the downwards trends in my personal streams. 2025 will need to be a year of intentional change in managing my work time, setting firmer boundaries, and finding a solution to working late nights, weekends, and limiting the streaks of long work hours. 2024 reached the peak in my work hours since starting time tracking in 2016, that's almost 10 years of time tracking! In the last four years, since starting my new job in 2021, the work hours are trending upwards (in 2022 I made adjustments to reduce work hours with some success), only to rebound higher in 2023, and much higher in 2024. In a future post, I will share the challenges of working for  a global high-tech giant like Amazon AWS from South Africa and the impact on personal time - it has been, and continues to be, the biggest challenge in maintaining my professional "happiness", especially when it comes to maintaining a regular "start day" and "end day" routines and rituals.

Overview since 2018
Here's the summary dashboard of my time spent in my personas since 2018:


What's my workflow for tracking all this data?
Nothing much has changed since I started my experiment back in 2016. I use Harvest for tracking my personal and professional streams. I use a free account, with one major project called "RAGE Time tracking". Tasks are related to my personas. I track my time from the minute I wake up till I go to sleep. Throughout the day, I switch between tasks, making sure I don't track my personal time as work time, including lunch breaks. The hours logged do track closely to 24 hours/day, for the whole year, with a negligible margin of error that's within reasonable tolerance (I'm still human!). The idea is to regularly inspect where my time is being spent, and make adjustments according to my prioritized streams. 2024 unfortunately wasn't my best year in reaching a harmony-state, something I'm not pleased about. The data helps me make sense of how my life is transforming, triggering moments of reflection for adapting or at times, just general acceptance of my current reality, it is what it is -- forcing me to make sense of my aspirations to perhaps re-calibrate (for areas where I have full agency to control and influence).

How has my workflow for insights generation changed over time - are genAI tools of any help?
In the early years, I used Excel as my main source of data insights. Later I moved over to Amazon QuickSight. I still use QuickSight to generate my analysis and dashboards, as I have a few transformations with calculated fields. I then export the Quicksight data tables as Excel file as the source data set for AI tools. Quicksight too, is a little quirky with ingesting new data, maintaining the integrity of calculated fields and sometimes data gets corrupted when updating its splice models. I spent a good few hours debugging failures in data alignment, missing rows due to errors in calculated fields (that should have "just worked").  I use a free account, so I'm unable to use any of the AI "Amazon Q" features - ideally, I'm expecting an interactive analysis/dashboard AI assistant that I can have a conversation with. Alas, there is no way to share or embed QuickSight dashboards openly, embedding QuickSight dashboards in blog posts would be cool.

Anyway, with the advent of ChatGPT, in the last two years, I started integrating AI data analysis. I spent the last few days with ChatGPT - suffice it to say, I'm not that impressed by ChatGPT's Data Analyst capability. Nothing much has improved since the last year. At least it can understand large datasets in Excel or CSV format which is cool, something that Claude, Gemini or NotebookLM don't currently support. 

ChatGPT's "Data Analyst" does a decent job performing exploratory data analysis, was able to infer what my dataset was largely about without me providing clues or guiding info. The biggest problem I encountered was loss of context, loss of memory, and complete loss of the data's runtime environment. I had to repeatedly reload the dataset because ChatGPT "lost the data", then re-coax it to understand the data fields. It also hallucinated and made simple mistakes calculating aggregated results. It got simple math wrong. At times, I had to specify in detail how to use the data fields to generate the insights I asked for. This was surprising as I had a much better experience on the model from a year ago. I'm using the latest 4o model, being a ChatGPT Plus subscriber. I feel that OpenAI team should just kill the Data Analyst as a separate feature and promote the Canvas Projects capability going forward.

On ditching the built-in "Data Analyst", I switched to the latest Projects capability in ChatGPT. I shared my dataset as project files, included all my blog posts on Personametry and RAGE as context data, and provided fine tuned instructions for the project as data scientist responsible for producing business intelligence reporting. I had a much much better experience using ChatGPT projects than Data Analyst - however - I still ran into issues with hallucination, over confidence in the AI's interpretation of data and calculated results. AI is still far from being a trusted source of business intelligence as far as I'm concerned. You need to take time to manually build your own reports and analysis, like the way I use Quicksight -- and then test the AI generates the same results. I've spent hours on this over the last few days - yes, it was a little frustrating - but nevertheless insightful. The more time I spend playing around with these tools, the more I am amazed at the potential power and future disruption in this space - and at the same time, the more I gain some comfort that there is still a long journey ahead. For my simple data set of hours logged by task, the AI doesn't perform 100% on first shot -- so for big businesses out there, don't go firing your business analysts, BI engineers anytime soon, thinking GenAI will replace these roles... IMHO, we are at least another 2 years away from maturing, if not, more. A key input is validation - you would need to generate reference test cases to validate all the metrics compute correctly to gain trust in AI-generated insights.

In 2023 I had some fun with Noteable's ChatGPT plug-in. I was really looking forward to Noteable's progress in the area of AI-assisted data intelligence, but alas, the company and product is no more. I'm now experimenting with something similar from deepnote, but it's early days - and also quite expensive for a general hobbyist as myself. I believe this is the future though.

Where do I see this experiment going?
Personal AI assistants are all the rage these days, some say 2025 is the year of AI agents. I'd like to build a truly personalized agent that is not just about rudimentary calendar integration, answering texts and emails - but an assistant that truly understands me as a person - across my personal and professional streams. Integrating my time tracking data, health, fitness and well-being data from smart trackers, integrated with my todo lists, etc. Coming back to personametry, I would like daily, weekly insights from my personal assistant. Imagine if we could have an assistant that says "Mo, I noticed you haven't exercised in awhile, and you're finishing work quite late. You've not had quality time with your wife and kids - and your recent trip to the ER is not boding well. I've booked dinner for you and the family at your favorite restaurant, and for the upcoming long weekend, I've made a booking at mountain lodge you will enjoy. I scanned your calendar, there's no major work deliverables or travel planned - so take some time to rest and recharge, or else you will burnout soon!"

So, what's the 2024 insights then?
Until I can get my personal agent implemented, manual Google slides will have to do. Check it out below!

Sunday, 14 January 2024

My experiment with ChatGPT as a recommendations engine using Netflix data

As some readers might have learnt about me by now, is that I enjoy data analytics, and more recently been curious about the capabilities of ChatGPT. So I decided to take my Netflix data and give it to ChatGPT code interpreter to see what it comes up with.

If you didn't know, as a Netflix user, you can get access to all your data by requesting it from under account management on the web site:


After a couple of days, you will receive an email from Netflix with a zipped file "netflix-report". Here's what my archive looks like:

The section that's important is CONTENT_INTERACTION. Recommendation engines are all about understanding a user's viewing behaviour: their content preferences, search history, viewing history, events that happen during playback, viewing activity - all inputs into what is called "viewer engagement". 

For 20 years I worked as a software professional building video technology systems. In 2004, I joined a research team building video recommendation engines. At the time, we focused on rules-based engines and used Amazon as the general poster-child, north-star - even then, Amazon's retail recommeder system was making headwaves. In 2004, it was still the early days of the internet. Set Top Boxes, the devices that enabled you access to satellite TV, were not always online. So the scope of our work was constrained to the embedded world of this device: limited compute, memory and storage power. We knew there needed to be a multi-pronged approach to video recommendations back then, with the bulk processing intelligence being done in the "back end" - headend - and recommendations eventually broadcast to the set top box over the air. Anyway, building software that learns viewing behaviours of users was an art back then - and even almost two decades later - remains still an art - although with the proliferation of many software-as-a-services providers, we now have so many options available "Recommendation engines-as-a-service". In my previous role as CTO for Africa's largest video entertainment company, over the years built our own stack, leverage open source recommendation engines. With new capabilities like Amazon Sagemaker and other services, I got our team to start thinking differently and transform to out-of-the-box recommender systems. Don't reinvent the wheel. Build flywheels instead. I left that team in 2020, 4 years later, I'm told the team's completed their transformation and using almost all their recommendation components off-the-shelf instead of building their own.

So what happens to content recommenders now that we have tools like ChatGPT, code interpreters and powerful data analysis? Could video recommendation engines be further disrupted - i.e. democratizing content recommendations to the new world of personal intelligent agents?

Experiment: ChatGPT as a content recommendation expert - Epic Fail

First, I asked ChatGPT to analyse the Netflix data set, then provide an analysis as a video recommendations expert. I've shared my Netflix data. Act as an expert video recommendations engine, recommender system, using all the state-of-the-art concepts for understanding viewer behaviour. Analyse the datasets and produce a detailed analysis and insights report into my viewing habits. What are my preferences? If you were a video content expert, how would you categorise me? What content will you recommend to me? Etc.

Feedback - Results, much better luck with DeepNote
A bit disappointing - ChatGPT struggles to analyse consistently, without errors. Too many errors, load failures and errors analyzing. It starts strong and then bombs out. I find it to be rather inconsistent. Had to wait a while and create a few sessions to get going. A bit of a time waster. It's a shame that ChatGPT has to restart its chain of analysis everytime there's a failure. "Regenerate" kicks off the process all over again. 3 sessions later, then I get bombed out as I've exhausted my time window - come back later. I pay for ChatGPT and still have to accept limited time-based usage. Crazy times. Switched over to Claude to see if it gave better results. Nope, Claude has severe limitations in file size uploads. Waste of time. Google Bard, equally useless. 

I then switched to Deepnote (an alternative to Noteable which is now dead), my experience was much better there. It turns out the Netflix data is sparse enough, missing vital data attributes like content genre classifications (like action, comedy, drama, romance, history, etc.) which makes it difficult to draw conclusions on viewing behaviour. This means we need to find a content database like TMDB to map my Netflix data to (i.e. complete the dataset by appending vital content attributes like genre, actor, director, studio, etc.), then we can build up a complete profile view of my usage, the content my household is inclined to and the for the last phase of the experiment, get the AI to recommend content from another catalog to surface recommendations for me. To get a glimpse of the potential power of an AI-coPilot used in DeepNote, I've shared my project as public here.

I'm not investing more time going down this rabbit hole today! However, it is certainly food for thought on potential new GPT-agents one can build now that OpenAI have released its GPT store. I suspect it's only a matter of time that someone builds a content recommender-gpt on ChatGPT's store, that can provide more diverse recommendations outside the closed walls of a streaming provider. I suspect we will have a resurgence in Content-Aggregator Wars in 2024!

Wednesday, 10 January 2024

Personametry 2023 - Wheel of life streams, hours logged


It's that time of the year when I sit down and review my time tracking data for the year. This time round, playing around with ChatGPT (whilst still maintaining my AWS Quicksight dashboards). I was quite looking forward to continuing to use Noteable's AI/Data tools, sadly the service shut down :-(

I've shared my dataset openly and also you can look at the ChatGPT transcript of the conversation and prompts here.

ChatGPT's overall summary:
  • Rest and Sleep (Individual): A substantial 2,856.11 hours, akin to the restorative power of a long, rejuvenating sleep every night.

  • Professional Work: Impressively, 2,051.20 hours were dedicated to your professional life, showing a solid commitment to career growth and achievements.
  • Family Time (Family-Man): A heartwarming 1,398.79 hours spent with family, which is like embarking on a year-long road trip with your loved ones, filled with bonding and cherished memories.
  • Spirituality (Individual): A profound 1,106.44 hours in spiritual pursuits, reflecting a journey akin to a spiritual retreat, deepening your inner peace and understanding.
  • Personal Time (Individual): 467.55 hours of 'Me Time', ensuring a healthy balance of personal space and activities, like taking a short, refreshing break each day.
  • Marital/Wife (Husband): 451.91 hours dedicated to marital life, resonating with the quality time spent in building a strong, supportive partnership.
  • Knowledge and Learning (Individual): 202.88 hours of enriching your mind, like attending a series of insightful lectures throughout the year.
  • Health and Fitness (Individual): 145.07 hours, a commitment to staying active and healthy, similar to a consistent routine of short, daily workouts.
  • Social (Friend): 117.06 hours, akin to enjoying meaningful social gatherings, reinforcing bonds and making memories.

Looking back, my time tracking is reaching steady state. Not sure I'm going to keep reporting these stats going forward, but I'll probably keep fine-tuning. For 2023 Scorecard, I'm glad to have focused and met largely my spiritual goals, work/professional goals was maintained year-on-year, despite the spike in work hours in the last quarter (I got "promoted", with extra responsibilities which means more work hours). Health and Fitness hours took a dive compared to 2022, but it seems that my Strava/Garmin activity tracking shows better performance in 2023 compared to 2022 (so more time logged doesn't necessarily equate to being for fit, or achieving more). Social time decreased because we lost some friends to emigration, and generally our year was focused on the kids as my son approached his final high school matric exams, we prioritised staying at home.

If you've read all my previous posts on Personametry, you would've learnt that as part of this experiment, even way back when I started in 2016, I wanted a personal-assistant AI to help me with my RAGE / Personametry framework. I wanted to engage in meaningful conversations with an AI-assistant, coach me, act as my council, gatekeeper, motivator, etc. I believe there is still a need for this and the current state-of-the-art still has some catching up to do. Nevertheless, I am quite enjoying my interactions with ChatGPT. It was able to understand my personametry data, derive some insights, create the views I would generally take a couple hours doing myself. It's just a matter of time until we get truly personalized agents, like a personametry-gpt agent. Here's what ChatGPT offered I should look into for 2024:

Here's my Personametry slides as usual:


Tuesday, 19 December 2023

My RAGE model compared to The Wheel of Life

 

[I asked ChatGPT to report on the differences between Meyer's Wheel of Life and Mo Khan's RAGE]

Comparative Report: Meyer's Wheel of Life vs. Mo Khan's RAGE Model

Comparative Report: Meyer's Wheel of Life vs. Mo Khan's RAGE Model

Introduction

This report provides a comparative analysis of two influential personal development tools: Meyer's Wheel of Life and Mo Khan's RAGE Model. Both models are designed to enhance self-awareness and personal growth, yet they differ significantly in their approach and methodology.

Meyer's Wheel of Life

  • Overview: The Wheel of Life is a holistic self-assessment tool designed by Paul J. Meyer, a pioneer in the field of motivational thinking and self-improvement.
  • Components: It typically includes segments such as Career, Personal Growth, Health, Family & Friends, Finances, Spirituality, Recreation, and Physical Environment.
  • Function: Users rate their satisfaction in each area, visually representing life balance and identifying areas for improvement.
  • Application: Widely used in coaching and self-help, it guides personal development and goal setting.
  • Learn More: Success Motivation Institute

Mo Khan's RAGE Model

  • Overview: The RAGE Model, an acronym for Reality, Aspirations, Goals, Expectations, is a framework for personal development conceptualized by Mo Khan.
  • Components: It involves introspection across various life 'personas', assessing the current reality, setting aspirations, establishing goals, and managing expectations for each persona.
  • Function: The model uses agile management techniques and a detailed scoring system for prioritization and tracking progress.
  • Application: Khan’s approach is detailed and systematic, suitable for those who prefer an analytical approach to personal development.
  • Learn More: Mo Khan’s Blog

Similarities

  1. Holistic Approach: Both models provide a comprehensive view of personal life, emphasizing multiple areas or aspects.
  2. Self-Reflection: They encourage self-assessment as a means of identifying areas of focus.
  3. Goal-Oriented: Each model promotes setting and pursuing personal goals.
  4. Personal Development: They are tools for enhancing self-awareness and guiding growth.

Differences

  1. Complexity: The Wheel of Life is simpler and more visual, while the RAGE Model is more complex and analytical.
  2. Approach: Meyer’s model is qualitative, focusing on self-rated satisfaction, whereas Khan’s model is quantitative, employing a scoring system.
  3. Focus Areas: The Wheel of Life has predefined life segments; the RAGE Model allows for personalized 'personas'.
  4. Tracking: The RAGE Model includes rigorous tracking mechanisms, unlike the Wheel of Life.
  5. Background: Meyer's model stems from motivational training, while Khan’s is influenced by agile product management.

Conclusion

Meyer's Wheel of Life and Mo Khan's RAGE Model, while sharing the goal of fostering personal growth, differ in structure, complexity, and application. The Wheel of Life is a straightforward tool for periodic self-assessment, ideal for a broad audience. In contrast, the RAGE Model offers a detailed framework for systematically setting, prioritizing, and tracking personal development goals, appealing to those who prefer a more structured approach. Both models provide valuable insights into personal development, and the choice between them depends on individual preferences and the desired level of detail and structure in personal growth planning.

Tuesday, 10 January 2023

2022 Personametry Tracking - Work/Life Balance & Harmony Update

Image Courtesy
Courtesy
It is time for my yearly ritual of analysing my time spent the previous year. This ritual is one of analysis and reflection, setting up the stage for planning & making new intentions for the upcoming year, 2023! 

I've been doing this exercise consistently over the last eight years! Am I crazy? Maybe?! I've become quite the data junkie, and I'm loving it! 

I know that tracking every activity and accounting for every minute of one's life might seem like overkill to most people. I on the other hand, actually quite enjoy doing so! :-) Primarily because having insights into how I spend my time has really helped me be more conscious and intentional about my aspirations, goals and expectations covering all dimensions of my life, seeking balance and harmony in my personal and professional streams. My methods allow me to focus and maintain discipline with my time...

This is my value system that describes my streams:

Muslim | Individual | Professional (Work) | Husband | Family-Man | Social/Friend

When someone asks me the following: Mo, how's life? Mo, how are you doing work-wise? Mo, how's things? Are you happy? Are you meeting your aspirations? Mo, what consumes most of your time these days? I can have a sincere and authentic conversation about it.

Yes, as some of my friends have argued that you "just know" instinctively where your time is being spent, on what and you just know the areas you need to improve on. Sure, I get that and agree. I find it much more useful to validate my instincts, verify anecdotes with quantifiable data & metrics to help me answer such questions: Where am I spending my time? Am I spending time in the right areas according to my priorities? Am I heading in the right direction? How am I growing? Where am I in my stages of growth across all my personas? How do I measure success? Am I growing holistically as a person?

In 2015, I researched productivity and personal development methods extensively, culminating to me creating my own frameworks:

  1. RAGE (Reality Aspirations Goals Expectations). Knowing yourself, i.e. what you stand for, your value system, by identifying Personas. For each Persona, define Aspirations/Goals that becomes your long term personal roadmap. What emerges from this is a scorecard that you can track your progress, see example from 2020.
  2. PERSONAMETRY is another concept I created that essentially captures key metrics about yourself, TIME being our most valuable resource. If time is our most valuable resource, do we not owe it to ourselves to account for it? For each Persona you identify with, Personametry is your personal telemetry. It can be extended to a variety of use cases, including overall happiness/stress sentiment analysis. If you're keen to learn more, check out this product specification document I created years ago, but alas, haven't developed the app for it as yet (alas, no time, wasn't a priority!)
Personametry complements RAGE by providing data insights, that I use to analyse if I'm trending in the right direction or not. Keeping a personal RAGE scorecard helps me keep track of how I'm progressing against my personal roadmap. In the last eight years alone, these frameworks have helped me reach my highest potential in climbing up the career ladder (making CTO, executive role), becoming debt free and remaining debt-free for 7 years and-running, improve my marriage enhancing the foundations (insha Allah), and rekindled relationship with family members, including long lost friendships, develop a more consciously confident identity as a Muslim in the workplace, make big bold decisions of starting over in my career (like walking away from CTO and big financial incentives rewards, take a pay-cut and step down in role) or start my own consulting, also make time to focus on paying it forward by offering my time to coach/mentor for free, etc. RAGE/Personametry has also helped me in being critically selective of where/what/whom I spend time with, I've learnt to say "NO" more often guarding my personas and setting boundaries, even with my own family and dearest loved ones.

Emerging from this experience so far are some interesting learning experiences, such as how one's goals and aspirations can change with time, depending on one's stage of life. For instance, where I'm at right now in 2023, is my profession is no longer what drives me (I'm consciously not seeking out the next promotion or level up because I've been there already and experienced the life of an executive), as I'm now seeking new experiences centred on creating more purpose, meaning and fulfilment...Having said this, I remain a pragmatist and so am open to new job opportunities that more closely align with my value system (example: NGOs/NPOs looking for CTO/CIO expertise, Africa-friendly timezone working hours is also being considered). If you know of any opportunities in this area, do get in touch!

Analysing 2022 v 2021 - Data Analysis & Insights

Since 2016 I've tracked 24,983 (±25K) activities as data points, tracking my life streams as: Muslim | Individual | Professional (Work) | Husband | Family-Man | Social/Friend - thus logging 60,572 (±60K) hours with an error tolerance of ±0.5% (99.5% capturing accuracy). In 2022 alone, I logged 8,715 hours, of which: Professional Work consumed 23%,  Personal Life 43% with the physical constraint of Sleeping accounting for 34%. Yep, we sleep for a third of our lives, and I have the data to back that up!

Suffice to say, I've made some good gains in 2022 that I hope to carry through into 2023. Check the slide show for the rest...

P.S. If you'd like to have a coffee/virtual chat about my RAGE/Personametry concepts, or you're curious to learn more, or seeking a mentor/coaching/networking opportunity or you simply want to learn about my workflows, then please get in touch!


Sunday, 14 August 2022

My 2022 mid-year review of Life/Work streams

Tis the period of mid-year performance reviews in the workplace, so I decided to inspect my own personal performance with my time tracking metrics covering the dimensions that make up my life and work streams. 

I've been tracking these metrics for a number of years already and at least once a year, share the analytics and insights from this lifelong experiment. I created the term Personametry which basically is about telemetry (metrics) about the self (personal). Feeding Personametry is a framework I've created for myself for personal and professional development, my RAGE model.

At the start of 2022 I shared insights from my past six years of tracking and also followed up another post zooming in on the 2021 year, highlighting the main time sinks and the impact on other related streams. I set a goal of turning things around in 2022 to get to a state of balance I enjoyed prior to 2021.

With half the year over, 2022 is fairing much better than 2021 - as I've been very intentional about the changes. 

Here are the headlines (comparing 2022 with 2021 for the first 7 months, January to July):
  • Work hours is down 28%
  • Spirituality is up 53%
  • Family time is up 27%
  • Social time is up 75%
  • Overall "Me Time" is up 16%
Holistically then, my process of re-calibrating in 2022 is having the desired effect. I'm spending time in the areas I've prioritized without significantly compromising on a major stream like my work (work obviously provides for the lifestyle I'm grateful for).

For more insights, check out the embedded slideshow :-)

In terms of my overall happiness sentiment and tracking my aspirations and goals as governed by my RAGE model, I'll share in a separate post in September '22. I've started to warm up more and more to Mo Gawdats' happiness formula which has helped me in coming to terms with the turbulence I've experienced with my job/career decision to disrupt and reinvent myself...stay tuned for the next write up!


Sunday, 16 January 2022

Diving deeper with personal analytics

In my first post of 2022, I shared some analytics of my life tracking data for the last 6 years. I couldn't help myself going down the rabbit hole with additional questions that could be used to trigger additional self reflection, which would then spark me to make deliberate changes in my life. It was quite fun going down the rabbit hole playing with AWS Quicksight and manipulating data fields to get to the answers I sought. 

When I have more time to play around, I think an AI/ML personal assistant should use my data to help me with insights. I believe there will be a market in personal analytics or metrics, or personal telemetry that I've coined the termed personametry back in 2015. At that time I wanted to build a product based on my RAGE model called personametry. Alas, that project is still on the backburner, and I've made a ton of excuses (to be honest) not getting it off the ground. Yes, my work got in the way, reality of family and financial obligations, then complacency and comforts-of-life (aka laziness). If I was serious about it, I would've made a plan. I resigned to keep tracking my data, keeping abreast of the progress of personal assistants, productivity apps and personal tracking devices, looking for the timing when things begin to fall into place!!

If you have additional questions you think might inspire changes & personal improvements, let me know in the comments section!

How do I breakdown my 24-hour days?

This is an interesting question. I decided to splice my 24-hours into "periods" and so I ended up with 8 (eight) partitions of the day. Since I track the start and end of my activities (tasks) captured in Harvest, I should be able to see how I utilize my time in a typical day. There is a missing element of productivity/impact as a result of that activity, which is a topic for another day.

Here is the code for splitting up a day, using a datetime field, in Quicksight:

I don't start my day at midnight and count 24 hours. Rather I account for the 24 hours from the point of going to bed or starting my day at 4am. I used to consistently begin my days at 4am for 2016-2020, but since relocating to Cape Town, it's been a struggle. I'm going to have to renew this habit in 2022. The partitioning of 24 hours days is not impacted though.

In addition to splicing the parts of day, I could look at how my routines differ between weekdays and weekends. For weekdays, I haven't yet filtered out real workdays, that is, not a public holiday or a leave day. 

With this new partitioning I can then answer these questions like:

Monday, 3 January 2022

2021 Life/Work streams review with 6 years data points

It's that time of the year when I review my personal time keeping metrics showing how I've spent my time over the previous year. I've been doing this exercise diligently since 2015, when I created a framework for myself called "RAGE" Reality, Aspirations, Goals, Expectations. Using ideas from software engineering and product management, I decided to map out my personal (life) and professional (work) streams across the many dimensions I was involved in (Muslim | Individual | Professional | Husband | Father | Friend | etc.). I focused on Time as the key metric to track, since time is one of the most important resource that should never be squandered. 

The idea is simple: if something is important to me, then I should be spending time in that area - but if I end up spending little or zero time on that thing, then that thing must have not been as important to me as I thought it was. 

Tracking time allows me to answer questions like: 

  • Am I spending time in the areas that are important to me? 
  • Which areas am I over indexing on that negatively impacts my other steams, robbing me of value?
  • Am I giving each stream the necessary amount of attention?
  • What decisions do I need to make when the data and anecdotes (feelings / instincts) don't match up?
Click here to check out my writings from previous years and here for an introduction to my RAGE framework for personal development tracking.
To read my 2020 review and reference my personal value system, click here.

2021 Re-starting Life & Work (again)

Driven by my personal planning through my RAGE model, 2021 was the year I hit reset. I uprooted my family and relocated from Johannesburg to Cape Town in December 2020. Earlier in 2020, I'd resigned from my C-level position of a very stable and secure job - at first - to take a year long sabbatical to work out my next move. This sabbatical was short-lived due to the uncertainty of Covid-19, I felt it too risky not to secure another job in 2021. I knew one thing for sure: I was no longer interested in building video entertainment technology applications "make people watch TV" and wanted to branch out into something else either in Cloud or e-Commerce. Thankfully I landed the first job I decided to interview for in cloud computing with AWS, Cape Town. A big departure for me because I was going back to core engineering building software, something which I've not done to that level of technical detail since 2010! I was also going to start as a senior manager and not a GM/CTO. So essentially I'd walked away from a high influence, high referent and hierarchical power, entrenched credibility and track record - to starting professionally all over again, from a "big fish, small pond" to being a "tiny fish, large ocean" fella, with zero credibility. I value learning new knowledge, building new relationships and gaining new experiences as more important than positional titles. My wife and kids also left their lives behind which we'd nurtured for a decade since relocating to Johannesburg (from UK), relocating and disrupting their lives to Cape Town with me - they too, hitting reset leaving much loved friendships, community and family-support behind. 

So 2021 would bring a massive disruption to my personal, professional and family streams. Time will tell if this grand reset is working or not. So my personal time tracking data is now more important than before.

This post shares my time tracking data for 2021 compared to the previous 6-years for comparison. Resetting one's life personally and professionally is not an easy thing to do. I've learnt much about this experience that I hope to share in future posts. In terms of the key KPIs of time tracking, 2021 went as well as can be expected considering the unusual context & challenges of Covid-19. In this post I share only the data and limited insights. There's some soul-searching I've yet to do on making drastic changes to my personas, which at the time of this writing doesn't seem to be major...

With year one done, so far, so good...no major regrets although the data has shown I need to recalibrate some streams if I want to get back to previous levels of balance.

Monday, 18 January 2021

2020 review, major decisions & re-invention

Around this time last year in January 2020, I shared (in this post) how I tracked against my personal & professional aspirations of the previous year 2019, accounted for my time spent and narrowed down the major questions (and hence decisions) that remained open. 

This was all before Covid-19 happened, but despite that disruption, I remained committed to holding myself accountable for realising my aspirations. I track these aspirations through a framework I created roughly five years ago, aimed at lifestyle design, something that is always a work-in-progress and is never complete. This framework is called my RAGE (Reality, Aspirations, Goals, Expectations) model. It has seen multiple iterations and has remained my guiding compass, even as I enter 2021 - the year of massive change for both myself as well as my family.

Looking back to 2020, it started with these open questions:
  1. How do I get my work hours of the previous three years under control? What am I willing to walk away from?
  2. Where next do I take my career? Do I remain with Pay TV moving further up to Group CIO/CTO or should I do something else altogether at the risk of going down a couple steps in the ladder?
  3. How serious am I about working with, or starting my own NGO/NPO non-profit?
  4. What am I going to do with my growing list of product / business start-up ideas?
  5. Should I leave South Africa and return back to the UK; or should I relocate to another country whilst still working in Pay TV?
We all know how 2020 turned out - but - despite that black swan - I nevertheless wanted to be antifragile and took bold action to not play it safe! Instead I dove head first into uncertainty, however, I did lay out a detailed plan. Those questions I needed to answer were Type 1 decisions (according Jeff Bezos' types of decisions), which called for careful deliberation & planning. So, using my RAGE model as my guide again, along with inspiration from a few folks (authors, friends, mentors, coaches & critics), I was able to address those questions by taking the following BIG decisions:
  1. I quit my job, my own sabbatical with no return policy - thus creating space for me to rest, recuperate & reflect. This wasn't an easy decision to make, as I was walking away from some rather good monetary incentives due to cash out in early 2021, and as a result of Covid-19, the prudent thing to do would've been to stick it out until the world recovered. Yet, I left anyway, putting into perspective What am I willing to walk away from?
    • This was only possible because 5 years ago, when I started my RAGE model, one of the aspirations for my persona as an individual was "To be debt-free on the road to financial independence". Since I was debt free, and maybe 30% on the road to financial independence, I had enough saved up to afford a break for at least a year.
    • Life is short, we've lost loved ones unexpectedly in 2020. I have tweaked my life model somewhat to weigh more strongly toward living a life of meaning, purpose & enjoying the present more.
  2. I decided to leave TV behind - switch domains - do something else preferably in cloud services. I will use my sabbatical time to ramp-up and then land a new job. This too wasn't quite that easy:
    • I'd reached a peak in my career with a highly respected company in the industry, although I knew I had gaps to close to move to the next level. It took a long time to mentally let go, but I found my flame again that helped me remember my past as inspiration to change my future.
    • I even considered going to medical school - but that didn't make much sense financially in terms of my family responsibilities and commitments.
    • Being the practical guy, I ended up cutting my sabbatical short because I landed a job much sooner than I anticipated - and as a result - ended up making not only a new job decision, but also a relocation to a new city decision too!
  3. Not serious about starting my own NGO - I spent a good few days unpacking this topic. I even went through a "finding purpose" retrospective and mind-mapped the options. Lo and behold, there appeared a golden thread throughout my life on working with blind and partially-sighted people. So I planned to use my sabbatical to explore that option...but that was short-lived. So decision: NO, not financially feasible for me. Instead I'll join accessibility-related community meetups at work, continue to donate money to causes and look to committing some of my time as a volunteer (which has been difficult, since it doesn't appear anywhere in my Persona priorities).
  4. Not serious about being an entrepreneur because I don't have the time nor the resources to focus on it properly. I will rather focus my energy into innovating at work. I will still build and maintain my ideas repository because I'm an ideas guy - but if the timekeeping from the last five years has shown me anything - it's not that important to me - a wantrepreneur! I will still look at angel investing opportunities though. Thus "Being an Entrepreneur / Run my own product start-up" has been deprecated as a persona. It's actually such a relief to just let that go and leave it all behind! Shedding unrealistic aspirations reduces stress and anxiety, reinforcing a sense of perspective. A cup can only hold that much water before overflowing, the same with life!
  5. Decided to remain in South Africa but instead try a new city, Cape Town. I was lucky to meet a career aspiration and a lifestyle aspiration (to live in a coastal city & enjoy nature) at the same time, but I'm still a little far off from having my own beachfront holiday homes so a 20 minute drive to the seaside is a good start though!!
Now, as I begin my 2021 journey, having addressed those serious questions, some of which were the cause of much stress and anxiety at the workplace, home & personal well-being fronts - 2021 will simply be about appreciating new experiences cross-cutting both work and life, aiming for harmony, acceptance, learning and growth (spiritual, personal & professional).  My personas remain largely the same priorities, their aspirations and specific goals will be adjusted for the next set milestones. I have hit reset so the process of reinvention will take time, I'm not going to rush things by being overly aggressive in setting unrealistic goals!

I have indeed made Type 1 (one-way-door) decisions, making it very difficult to go back now. I have rekindled my flame and now it's up to me (as it has always been) to make my life more interesting and meaningful!

2021 is about re-invention
I believe it can be done!!

As usual, I share my RAGE metrics with you - see below for my 2020 time-keeping performance...
Hint: Click on the images to view them properly.

If you'd like to chat about my RAGE model, tools and other frameworks I use to help manage my personal & professional life, please feel free to reach out! I believe as human beings we are all striving to make sense of our life/work/world, regardless of our culture, belief systems, etc. I believe I have found a method that could be useful...and I'm happy to jump on a video call with you for free life/work coaching! It has helped a few people already, so maybe that says something??

Friday, 3 January 2020

Year 2019 in Review, Welcome 2020!

I'm now entering my fifth year of time logging and keeping track of all my "life & work"-streams in an effort to make sense of my time sinks, cross-checking my aspirations & goals with reality, in the hope of tuning, re-calibrating areas to be more in harmony with my purpose / value system, sometimes triggering some decisions that could take my life-and-work in a different direction altogether. So I've become a bit of geek with the #quantifiedself so much so that I log almost everything all the time. This habit developed naturally as I spent five years consulting, needing to keep track of all my hours and tasks for billable hours. So I took this all the way into treating my entire life as one big project with multiple tasks that needed accounting!

In 2015, I spent a lot of time soul-searching to make sense of not only what I want out of my life but my work/career aspirations as well, since a major part of my life involves my occupation in the software industry. So I came up with a model called RAGE (Reality, Aspirations, Goals, Expectations). The way the model works is to split yourself into "Personas" sliced into Personal and Professional streams. Using some tools from Agile, such as user stories, you describe for each of your personas, your aspirations, reflecting on your current reality, then setting goals and expectations. Your personas are prioritised by value, which is basically an instinctive, gut-feel assessment of the value/importance of the stream, in comparison to the others. I'd created template and a matrix tool that allowed for easy prioritisation, and a template to help others on this journey as well. My hypothesis still remains valid that tracking time is one way of understanding where my time is being spent, proposing "I will naturally spend most of time dedicated to the persona streams that are of importance to me" - but the reality can sometimes be quite surprising!

In this post, I continue with my annual ritual of starting the new year by analysing what went down the previous year (2019), and how/what I would need to re-calibrate to get me on track with my life's journey-mapping into 2020:
  • Recap my personal value system - persona matrix & priorities
  • Snapshot of tracking my RAGE progress by milestone reviews heatmap
  • Performance appraisal - Did I achieve my intended outcomes / goals set in Jan 2019?
  • Quantifying every hour of 2019 - where did I spend my time, what did I do?
  • Does it look like I have my life-work balance under control?
  • Am I working too much, sacrificing my personal and family streams?
  • Am I enjoying my current job?
  • What are the main things impacting my future personal & professional aspirations?

Saturday, 5 January 2019

2018 Year In Review & 2019 Thoughts

It's that time of the year again where I look into the data for timekeeping over the past year to make sense where I spent my time, and cross-check with reality, in terms of my aspirations and goals that are split between different areas of my life by Personal & Professional areas. The idea is to gain insights from this data and re-calibrate areas of focus for the upcoming year.

Unfortunately, I haven't made much in the way of drastic progress in 2018 compared to 2017, the profile is largely the same - that my professional (work) life has consumed more time (a constant theme), my personal life in terms of family commitments are reasonably on track, and the biggest area of neglect is on my own personal, individual streams (hobbies, ideas, health and fitness). However, since I started the RAGE model experiment, I have made some good wins on other areas, so the model works, but there's still more to be done in this area - specifically around outcome-based goals.

Recap my RAGE Model (Reality, Aspirations, Goals, Expectations) Tracking

I wanted to map out the different areas of my life that defines me, split by two major areas: Personal & Professional. 
For each area, I defined some personas or streams. For example - in the Personal area, I'm a Husband, Father, Family-Man, Individual, etc. For the Professional area, I'm a professional (my main job), a colleague, etc.
For each Persona, I map out my current Reality, ideal Aspirations, and then from those two, set some Goals & align some Expectations to achieve.
Another aspect to this experiment was tracking my overall happiness and well-being. If I spent time in the areas of priority, the theory is it should count towards me being happier.
I prioritise the Personas using a simple matrix that defines how I value and rank them. I then use detailed time tracking to track the time spent doing activities for each area. The theory is that I should be focusing time and energy on the areas that reflect the ranking and priorities I set. This is the core data for analysis. For more details on how I actually do this, I am still using the manual ways as described in the original posting. Since the original version of the Personas, I'm now on version 6 which currently looks like this:
Current Persona Matrix Rankings
What this ranking does is basically show my decision-making rules: Life (Husband, Father, Family) is more important than Work (Job), which is more important than my Individual Personal streams (Hobbies, Pet Projects, Me Time, etc.). A simple-enough value system that I use to navigate through challenges.

It all looks good on the paper model, but in reality, the data highlights some food for thought that I really need to take action in 2019.

What are the big challenges for me?

What triggered my creating the RAGE model and start the detailed time tracking activities was essentially about accounting for my time, addressing the hard realities:
  • Being a professional, i.e. having a stable income stream is currently a hard reality constraint. I need an income to support my family - so this is something I should not compromise on - but I still need to control it - I should not be overworking, at the expense of my personal life interests. So the data on work hours is important. When I read about pursuing dreams, passions, etc. about breaking out, taking risks, quitting your job etc. the reality around finances, lifestyle and family stability kicks-in - it's not an easy thing to do...this is a hard reality. I have to think of ways to ensure I do my best work, provide the best service to my employer, but not let work over consume me at the expense of my other streams (which as the data shows is not actually happening). Unless I can find a way to create a passive income stream outside of my main job, this constraint is going to be around for a while. The outcome for this year must be to bring my work-hours to a decent level freeing up time to focus on my personal interests.
  • It's quite difficult to switch off from the office these days - even whilst at home, social media chats through Slack & WhatsApp are disruptions, that can't be tracked in hours - so whilst in "family mode", I must respond to chats - this time is unaccounted for. If I were to include all these moments as "work", then work-time increases...which is why this topic of "work-life integration" is becoming more mainstream.
  • The functions of resting and sleeping for a human being is something that must be respected, and can't be compromised. I maintain an average of 8 hours of sleep per night, so this is a hard constraint. Eight hours has been validated as the ideal, I can go on for a few days with less sleep, but it's not sustainable. This means that the rest of my time must be allocated around this, with Work/Professional consuming a large chunk of this.
  • Giving focus to my own personal interests as an individual, outside of being a Husband / Father / Family-Man, etc. seems like I'm sacrificing my own interests, i.e. putting myself last - and this is where the spiritual dimension of being a Muslim comes in to help - it's sometimes a struggle to deal with these frustrations.

2018 Data Insights - Tracking the Time / Hours spent

There was roughly 8,766 hours in 2018 (365.25 24-hour days), which I tracked and logged a total of 8,820 hours, which is not bad, the errors could be attributed to human error in logging (54 extra hours).

Where did the time go?

2018 Persona Hours, focus on Working Hours & Overall Happiness at work

There were 250 work days in 2018, excluding 12 public holidays. I took 34 days off as leave days, which left 216 work-days. Assuming an 8 hour workday, the capacity for work hours would be 1728 hours.
My actual work hours logged were 2155.4 hours, an excess of 427.4 hours as "overtime" which I don't really get paid for. This equates to an extra 53.4 days worked, an additional 2.5 months of extra work - which took away time from other areas, like for instance, time I could have used for my personal projects.
The table below summarises the major streams - highlighting in red, the months where work-hours exceeded the normal bounds. Overall split between life and work remains consistent with the previous two years, with my own personal individual streams taking much of the knock:

So it's clear that work-hours is an area to be controlled to free up time for allocating to personal, individual streams.

General Happiness & Well-Being at Work

I continue to track my overall happiness levels at work on a daily basis. I have also started tracking the bad days in terms of sleepless nights. In 2018 I had my fair share of stress at work that resulted in some nights where I hardly slept a wink, tossing and turning, worrying about issues at the office as well as my future in the company. This is a new stress that introduced itself last year, that I need to better manage. I tracked 12 sleepless nights, this is about 4% of the time. However, in general, the picture still looks good - I'm enjoying the work on the whole:

The last quarter of 2018 did see an increase in bad days - we had some challenges with the platform in terms of stability, new boss, changes in teams, and overall tensions and conflicts to manage & people resigning. This what triggered my blog post on workplace 3.0 last year. Additionally, my health took a bad turn as well in November. The number of "indifferent / neutral" days seems to be increasing - an area to keep track of. But in the grand scheme of things, there is more upside than downside at work, so this is still looking good! However, I do need to plan in personal time (leave days) more in the year to maintain a healthy balance.

Life in general is good, but my Personal streams are taking a knock

In general, overall - the time keeping does not contradict the priorities and rankings for my personas. I am also in a good space - health, wealth and mental space is in equilibrium (maybe this is because I've just done three weeks of of chilling out, relaxed summer vacation - back to office come Monday...). As I introduced the post earlier, on paper, I should be happy that my hours are reflecting the priorities I set & committed to...however, I can't help but feel a little down that overall my individual self interests are taking a knock...

In terms of the streams I see as my personal individual persona (i.e. the things I'm interested as person, outside of me being a Husband / Father / etc.), here's a view of the percentage focus per month (still highlighting the months where work exceeded the norm):

The positives highlighted in green:
  • Reading books - did well enough to track against my goal of 24 books, ended up completing 21 books last year. Not bad.
  • Spirituality - tracking very nicely, spent 10 days in seclusion in June, time well spent.
  • Me Time - this is time I spend by myself, thinking, exploring or even binge-watching shows ;-)

The areas of concern are:
  • Health & Fitness - dismal year. I had some health issues creep up on me last year. Not good.
  • Cycling - very little done. According to my Strava logs: 29 days, 47 hours, 585km.
  • Blogging - regressed big time - need to do at least one post a month
  • Entrepreneur - my ideas still collecting dust. Pathetic, makes me really wonder about this!

Major Outcomes for 2019: Intent

Broadly speaking, here's some outcomes I'd like to focus on this year, the detail in terms of specific targets is still tracked manually in the spreadsheet template:
  • Professional
    • Get work-hours down to a manageable level, target no more than 170 hours per month
    • Continue to build a strong leadership team thus removing me as a bottleneck, focus on strategic outcomes, less operational
    • Spread in more leave time, reduce sleepless nights to zero
  • Personal - Individual - Entrepreneur 
    • Spec out my Rage/Personametry product idea and get an MVP done, even if it's manual
    • Attend at least 6 Start-Up meet-ups this year
  • Personal - Individual - Health
    • Improve current fitness state - there should be no 0% activities in a month
  • Personal - Life & Family
    • Introduce consistency & routine into happiness building activities - at least once a month we should develop a routine around the things we enjoy doing as a family

Tuesday, 1 January 2019

Am I hunting antelope or field mice?


I came across this question from Tim Ferriss' Tools of Titans during my summer reading, it's quite apt  for my first post of 2019, as I have a feeling it will probably be the question I will pivot around again and again during 2019. It features as question #13 of Tim's 17 questions that changed his life. I've lifted the description here on this blog so I can keep coming back to it.

Am I hunting antelope or field mice?

Quoted from Tools of Titans, 17 Questions that changed my life:
Newt Gingrich is one of the most successful political leaders of our time...Now that he's in the private sector, Newt uses a brilliant illustration to explain the need to focus on the big things and let the little stuff slide: the analogy of the field mice and the antelope.
A lion is fully capable of capturing, killing, and eating a field mouse. But it turns out that the energy required to do so exceeds the caloric content of the mouse itself. So a lion that spent its day hunting and eating field mice would slowly starve to death. A lion can't live on field mice. A lion needs antelope. Antelope are big animals. They take more speed and strength to capture and kill, and once killed, they provide a feast for the lion and her pride. A lion can live a long and happy life on a diet of antelope. 
The distinction is important. Are you spending all your time and exhausting all your energy catching field mice? In the short term it might give out a nice, rewarding feeling. But in the long run you're going to die. So ask yourself at the end of the day, "Did I spend today chasing mice or hunting antelope?"

Initial Thoughts?

Courtesy
Five years ago, I used this illustration to pitch my situation at work to my then bosses - I felt like a lion trapped and being tamed by a corporate structure that was stifling the value I could bring to the organisation especially in terms of working across group-silos. This pitch resulted in me being freed up from the HR constraints and kick-started my journey into consulting which lasted about 4.5 years...

Then having spent enough time consulting, it felt more and more that I ended up hunting field mice again (consultants were excluded from big meaty execution decisions and did not have a seat at the table), so I went back into permanent with the same company...I am getting my share of antelopes now with a seat at the table, but more often I find myself  being dragged into field mice problems. My solution to this problem is through effective delegation and empowering my people, the challenge is that my peers and bosses have trouble appreciating this tactic...what I view as field mice problems is not always seen in the same light by the people that further up in the food chain - so maybe I'm not a lion after-all ;-) or maybe I need to find another pride of lions with the same mindset as I...??

It might well be that my current job is not the antelope I'm searching for...that my real antelope is still out there evading me, and could it be  that my fear is the only thing that is holding me back??

So that's thoughts on professional life...in terms of family life, this story could also be applied as well. Being a husband and a father to three children, whilst very rewarding on levels that can't really be measured or quantified well, is probably the most challenging experience one can have...in my case it's about letting go of being a control-freak, not sweating the small stuff (field mice) and focus on the bigger important stuff...whilst I'm an expert project manager in the professional world, the project of a family and raising children is THE most intense project to manage in life...

2019 must be the year I either bag an antelope or at least make strides in identifying bigger game...My RAGE model and my focus on the 80/20 principle in all aspects of my work and life are tools that are helping me on this journey - and if I were to assess my progress since starting with my RAGE model tracking, then things don't look bad at all.

My gut tells me that 2019 is going to be an interesting year for me professionally...

[Update: August 2023 - I did indeed bringing down my antelope in 2019, reaching heights in my professional career to C-level, as well as step-changing my family-life away from field-mice problems...but the interesting thing now in mid 2023, feel I need bigger antelopes again, since I'm in Africa, I need to hunt a buffalo]