Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a "Getting started" guide for the dataframe API #7643

Merged
merged 24 commits into from
Oct 16, 2024

Conversation

abey79
Copy link
Member

@abey79 abey79 commented Oct 8, 2024

What

WIP getting started guide. A skeleton with some working code for now. Very much in need of feedback.

may need this to pass CI:

Checklist

  • I have read and agree to Contributor Guide and the Code of Conduct
  • I've included a screenshot or gif (if applicable)
  • I have tested the web demo (if applicable):
  • The PR title and labels are set such as to maximize their usefulness for the next release's CHANGELOG
  • If applicable, add a new check to the release checklist!
  • If have noted any breaking changes to the log API in CHANGELOG.md and the migration guide

To run all checks from main, comment on the PR with @rerun-bot full-check.

@abey79 abey79 added 📖 documentation Improvements or additions to documentation include in changelog labels Oct 8, 2024
Copy link

github-actions bot commented Oct 8, 2024

Deployed docs

Commit Link
0f0868f https://landing-pw8hlmvkk-rerun.vercel.app/docs

@abey79 abey79 force-pushed the antoine/data-out-tutorial branch 3 times, most recently from 6e0cc8b to 02d3921 Compare October 9, 2024 15:26
@abey79 abey79 changed the base branch from main to antoine/rename-filter-is-not-null October 14, 2024 10:41
@abey79 abey79 changed the title Getting started guide for the dataframe API Add a "Getting started" guide for the dataframe API Oct 14, 2024
@abey79 abey79 added feat-dataframe-view Everything related to the dataframe view feat-dataframe-api Everything related to the dataframe API labels Oct 14, 2024
@abey79 abey79 marked this pull request as ready for review October 14, 2024 12:26
@abey79 abey79 changed the base branch from antoine/rename-filter-is-not-null to antoine/nolint-blocks October 14, 2024 12:31
@abey79 abey79 added the do-not-merge Do not merge this PR label Oct 14, 2024
@abey79 abey79 force-pushed the antoine/data-out-tutorial branch 3 times, most recently from 5fe26ad to fe0255c Compare October 14, 2024 18:40
@abey79 abey79 removed the do-not-merge Do not merge this PR label Oct 14, 2024
@Wumpf Wumpf self-requested a review October 15, 2024 07:48
@Wumpf Wumpf self-assigned this Oct 15, 2024
Base automatically changed from antoine/nolint-blocks to main October 15, 2024 13:46
@Wumpf Wumpf mentioned this pull request Oct 15, 2024
6 tasks
docs/content/getting-started/data-out.md Outdated Show resolved Hide resolved
docs/content/getting-started/data-out.md Outdated Show resolved Hide resolved
docs/content/getting-started/data-out.md Outdated Show resolved Hide resolved
@Wumpf
Copy link
Member

Wumpf commented Oct 16, 2024

It would be nice to have these below each other
image

</picture>

Here is how this view is configured:
- Its content is set to `/blendshapes/0/jawOpen`. As a result, the table only contains columns pertaining to that entity (along with any timeline(s)). For this entity, a single column exists in the table, corresponding to entity's single component (a `Scalar`).
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we call it entity path filter right now. Saying content here makes it hard to find in the ui

- The `frame_nr` timeline is used as index for the table. This means that the table will contain one row for each distinct value of `frame_nr` for which data is available.
- The rows can further be filtered by time range. In this case, we keep the default "infinite" boundaries, so no filtering is applied.
- The dataframe view has other advanced features which we are not using here, including filtering rows based on the existence of data for a given column, or filling empty cells with latest-at data.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

embedding code here for the blueprint would be amazing 💭

docs/content/getting-started/data-out/export-dataframe.md Outdated Show resolved Hide resolved
- The last columns is named `/blendshapes/0/jawOpen:Scalar`. This is what we call a _component column_, and it corresponds to the [Scalar](../../reference/types/components/scalar.md) component logged to the `/blendshapes/0/jawOpen` entity.
- Each row in the `/blendshapes/0/jawOpen:Scalar` column consists of a _list_ of (typically one) scalar.

This last point may come as a surprise but is a consequence of Rerun's data model where components are always stored as arrays. This enables, for example, to log an entire point cloud using the [`Points3D`](../../reference/types/archetypes/points3d.md) archetype under a single entity and at a single timestamp.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

excellent clarification at just the right moment

docs/content/getting-started/data-out/analyze-and-log.md Outdated Show resolved Hide resolved
docs/content/getting-started/data-out/analyze-and-log.md Outdated Show resolved Hide resolved
docs/content/getting-started/data-out/analyze-and-log.md Outdated Show resolved Hide resolved
@Wumpf Wumpf merged commit 072070f into main Oct 16, 2024
35 checks passed
@Wumpf Wumpf deleted the antoine/data-out-tutorial branch October 16, 2024 13:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
📖 documentation Improvements or additions to documentation feat-dataframe-api Everything related to the dataframe API feat-dataframe-view Everything related to the dataframe view include in changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants