Skip to content

Home

Jump to bottom
Bil Arikan edited this page Mar 8, 2024 · 96 revisions

Purpose

This repository, wiki, and plan are designed as an educational project focused on utilizing xAPI to visualize how a browser-based application measures customer enablement.

It will involve the learning of xAPI functionality, evaluating how it integrates with various platform architectures, and determining practices for reporting the data. It will also cover the identification of effective measurement methods and visualization practices to complete this process. The project encompasses a full cycle of implementation, testing, integration, and confirmation of the successful implementation and insightful data represented to visualize how a browser-based application could measure customer enablement.

Current Landscape of scenario

The current operational framework of scenario is depicted as a siloed and segmented tapestry of data collection and analysis, where the Learning Team, Marketing Team, Customer Success and Support Teams, and the Product Team operate with distinct data gathering and measurement methodologies. While there are instances of data-sharing within specific teams for key measurements, there is a noticeable lack of interconnectivity and integration with the wealth of customer experience data held in different systems. This compartmentalization results in a disjointed and incomplete picture of customer engagement, enablement, and success, as shown in the visual diagram. The diagram illustrates the isolated data pools within each team, emphasizing the necessity for a unified data strategy that bridges the gaps between these islands of information. image

Proposed approach to scenario

The proof of concept is designed to automate the aggregation and implement a data plan to transparently demonstrate the effect of initiatives on customer engagement and enablement. Moving away from the retrospective assemblage of disparate data points to gauge success, this method seeks to establish a proactive and integrated framework for analyzing the influence of learning efforts from the beginning. The accompanying visual diagram conveys this new approach, with streams of data from Community Forums, Marketing Campaigns, LMS Activity, and Product Telemetry converging into a Learning Record Store (LRS). This consolidation is meant to facilitate a seamless flow into BI Reporting, where data modeling and analysis can provide immediate insights into the impact of learning initiatives, confirm user enablement, and accelerate feedback response times, offering a more holistic view of success and enablement measurements. image

Initial Milestones Established

This section outlines the key milestones for the project, each representing a critical phase in the development and implementation process. The milestones cover everything from the initial setup and integration of technologies like xAPI, LMS, DAP, and BI tools, to the creation of fictional content for testing, and finally, to comprehensive system testing.

  • 1. Static Site Statement: Create and configure a static webpage using the Astro framework to send xAPI statements based on user interactions to a testing endpoint.

  • 2. xAPI from LMS: Set up Moodle as the Learning Management System, incorporating xAPI to track and report on learning activities, and ensure correct data transmission to an LRS.

  • 3. xAPI from DAP: Integrate Pendo with Akaunting to track user interactions, configuring it to generate and send xAPI statements for engagement analytics.

  • 4. LRS Setup: Install and configure an SQL-based Learning Record Store (LRS) to receive, store, and manage xAPI statements from various sources.

  • 5. BI Tool Setup: Select and configure a Business Intelligence (BI) tool to connect with the SQL LRS for data analysis and visualization through dashboards.

  • 6. Measurement Strategy & KPIs: Identify and document key metrics and KPIs relevant to customer engagement and learning outcomes, planning their visualization and ongoing tracking.

  • 7. Data Model & Collection: Develop a comprehensive data model supporting the project's measurement strategy, and implement mechanisms for data collection across all systems.

  • 8. Application Segment for Scenario: Choose a segment of Akaunting for a fictional scenario, setting up user interaction tracking and xAPI reporting for customer usage measurement.

  • 9. Fictional LMS Course Content: Create course content within Moodle that includes xAPI activities, focusing on Akaunting use, and test for correct xAPI data generation and sending.

  • 10. Fictional Documentation Article: Develop a documentation article on an Astro-based page, designed to send xAPI statements for reader interactions, relevant to project goals.

  • 11. Fictional Video Enablement Content: Produce video content for the documentation page to enhance user enablement, incorporating xAPI tracking for interaction analysis.

  • 12. Fictional DAP Onboarding Content: Design and implement onboarding content within Pendo for the Akaunting product, configuring xAPI tracking for user interaction insights.

  • 13. LRS Data Integration: Ensure all data sources (webpage, LMS, DAP) are correctly configured and integrated to send xAPI statements to the SQL LRS, conducting tests for data flow accuracy.

  • 14. BI Integration & Data Model: Complete the integration of the BI tool with the LRS, ensuring data accuracy in dashboards and reports, and refine the data model based on initial insights.

  • 15. System Testing: Conduct thorough testing of all systems and integrations to validate the reliability and accuracy of data capture, reporting, and the effectiveness of the measurement strategy.

Tools for the Proof of Concept

The proof of concept for our project incorporates a selection of tools chosen for their simplicity, adaptability, and cost-effectiveness:

  • Astro Framework: Utilized for creating fast-loading, static web content that is essential for front-end interface experiments.
  • Akaunting: An open-source financial platform that will act as the backdrop for testing business application interactions.
  • Pendo: Employed for gathering in-depth user behavior data within our product, essential for real-time engagement analytics.
  • EazyBI: Chosen for its robust data visualization capabilities, it will serve as our main tool for analyzing and reporting outcomes.
  • xAPI: The backbone for tracking and recording learning experiences, providing a standardized data format for our experiments.
  • SQL LRS: A reliable data repository to store xAPI statements, enabling structured storage and retrieval for analysis.
  • Docker: Used to containerize the components of our project, ensuring that the entire proof of concept is easy to replicate and deploy.
  • GitHub: Hosts the experiment's codebase, version control and collaboration, the integrated Wiki is used to document the solution processes, and the integrated Project tool helps to monitor progress.

These tools are integral to our project, serving specific roles from data collection to analysis, ensuring that our proof of concept remains practical and accessible for collaboration and validation.

Reading List

Astro The web framework for content driven sites

  • Home page link
  • Documentation link
  • Astro prerequisites link
  • Starlight theme for Astro link
  • Build an Astro site with Docker link

xAPI The Experience API (or xAPI) is a new specification for learning technology that makes it possible to collect data about the wide range of experiences a person has (online and offline).

  • xAPI.js Communicate over xAPI using JavaScript link
  • TinCanJS JavaScript library for xAPI link
  • XAPI.com Helping you understand and implement xAPI link
  • ADL xAPI Experience API (xAPI) Standard link
  • xAPI specification link
  • xAPI 2.0 specification, documentation, and source code link
  • cmi5 specification link
  • cmi5 best practice guide link
  • Large list of xAPI resources by Jason Haag link
  • xAPI launch link
  • xaAPI wrapper link
  • Intro to Developing Web-based xAPI Content link
  • xAPI wrapper 1.11.0 reference link

Docker Provides the ability to package and run an application in a loosely isolated environment called a container

  • Documentation link

SQL LRS The Apache 2.0 open source xAPI Learning Record Store from Yet Analytics

PostHog A site analytics platform

  • Documentation Link
Clone this wiki locally