The reference implementation in the IMS public repository looks abandoned and I can't find any project that makes me comfortable. I prefer an open source project, but a commercial one can be also interesting.
I have a working project but is just a listener for the events, but I want a better way to process the events and store them efficiently.
What are you using as Event Store for your Caliper stream?
Hello Mark,
I've found useful information in this area before , but there are only 6 contents and none of them answer to the topic I refer in this thread, can you be more specific?
Here is a snippet of an email thread I had going with Daniel Knight and Scott Hurrey, both with Blackboard, at a time when I was inquiring among the community for something similar with Caliper. I had a MongoDB-based event store, but didn't know what to do with the data that it was ingesting. I also recommend checking previous Bbworld archives for this type of info.
"Internally, we use a variant of an ELK stack (https://www.elastic.co/products?camp=Branded-US-GGL-Exact&src=adwords&mdm=cpc&trm=elk%20stack&gclid=EAIaIQobChMIpf_Gl-WH2QIViiaGCh3f8gboEAAYASAAEgK7MPD_BwE) to index and query the events we receive from Learn instances. This allows us to measure activity level among users in a particular course (Student Activity Report). We also use this same system to report on the use of Kaltura by students, but in that case, it is based on Caliper events received from an external party (screenshot was on slide 10 of my 2017 DevCon presentation). We also have a data warehouse (Snowflake) which can be used to query the event data.
IMS Global’s example event store uses MongoDB, but there’s no requirement to do so. Internally, Blackboard doesn’t use MongoDB with our Telemetry/Analytics service. You can use whatever data store you are comfortable with and allows you to do the types of queries you would like. MongoDB does have fairly good documentation including tutorials (https://docs.mongodb.com/) around how to do queries, MapReduce and aggregation. The important thing to note is that MongoDB does not have joins, so you either need to de-normalize data as you insert into the database or combine data from multiple queries on the server."
Thank you very much Mark,
I will try to compose a solution based on Amazon Redshift and the Kinesis Data Firehose API in order to store the events. I'll see how the costs scale...
I think Scope from Purdue uses Caliper data to generate its analysis; see https://www.itap.purdue.edu/studio/scope/.
Thank you Stephen, I'll reach them for additional info.
You may also find the OpenLRW project of interest; it supports both xAPI and Caliper event data; see https://github.com/Apereo-Learning-Analytics-Initiative/OpenLRW
This one is great for tinkering, and I like the technology stack! Thank you very much.
Help
Privacy
Behind the Blackboard
Blackboard.com
Alberto, head over to the "Standards" area of the Developer Community and check out the topics surrounding Caliper.
Mark