Requesting example for live data monitoring #8
Replies: 2 comments 11 replies
-
|
@acrlakshman I am not sure if I can share screenshot of results data but here is a screenshot of my jobs running at AWS with cloud formation stack called SOCA Screenshot showing m CFD jobs running at AWS is here:
|
Beta Was this translation helpful? Give feedback.
-
|
@sidbannet oh yes, you might have run mostly company related cases, I thought you might have some toy test cases ran. That' ok, I got the idea. I shall get back to you with some code update and see what you think about future direction. |
Beta Was this translation helpful? Give feedback.
-
|
Usually I write data in AWS EFS and then use SageMaker (AWS Notebook instance) to read the data from EFS in real time and go through the analysis of the data while the simulation job is still running. |
Beta Was this translation helpful? Give feedback.
-
|
That means, if AWS provides an API to talk to their storage filesystem (EFS), then we could do that real time analysis on an extension of this project. We can potentially extend this project as web app where an extension to current scripts can act as backend and a light weight front-end that loads jupyter notebook from this project can talk to user data whether that data be on AWS, GCP, etc. What do you think? |
Beta Was this translation helpful? Give feedback.
-
|
I like your idea of building out post processing toolset as well. I have it obviously for my work use, and left it out from this repository for quicker adoption of loading the data into |
Beta Was this translation helpful? Give feedback.
-
|
I am trying to find a way to make you a maintainer for this repo as well. @acrlakshman |
Beta Was this translation helpful? Give feedback.
-
|
I think from CONVERGE' side, there is an effort to keep consistent API, but I do not know complete details. However, we can release multiple versions of this project to be in sync with various changes from CONVERGE side too. It sounds more work, but it is a possibility. |
Beta Was this translation helpful? Give feedback.
-
|
You can just add me as a collaborator, and depending on my contributions, you may bump my role later. |
Beta Was this translation helpful? Give feedback.
-
|
I can't see you while trying to invite you as |
Beta Was this translation helpful? Give feedback.
-
|
Nothing that I have done to stop this, can you search without |
Beta Was this translation helpful? Give feedback.
-
Hi @sidbannet, during your talk at CONVERGE UC, you mentioned that you run CFD jobs on AWS or some other cloud provideres and monitor the results. Do you have any screencast to share?
post, we could build a package via ipywidgets that can group multiple mostly used post-processing steps into one widget and provide it to user via jupyter notebook. In its current form, this project is made of scripts, by adding more features along with classes that compose of widgets, we can make this more mature.Beta Was this translation helpful? Give feedback.
All reactions