Skip to content

Commit

Permalink
Improved the CV project and changed the order
Browse files Browse the repository at this point in the history
  • Loading branch information
olekscode committed Feb 7, 2024
1 parent 5438f3a commit 25a8e32
Show file tree
Hide file tree
Showing 2 changed files with 61 additions and 58 deletions.
119 changes: 61 additions & 58 deletions data/ideas.json
Original file line number Diff line number Diff line change
@@ -1,120 +1,123 @@
[
{
"id": "object-detection",
"title": "Enhancing Cormas with Computer Vision",
"img": "etienne-cv.png",
"id": "game-tiles",
"title": "Adding Game Tiles and Sprites to Cormas",
"img": "game-tiles.png",
"supervisors": [
"Etienne Delay",
"Milton Mamani Torres",
"Oleksandr Zaitsev"
],
"description": "The goal of this project is to enhance the interactive functionality of Cormas by building a computer vision system for detecting tangible objects such as board game pieces. Such a system would permit people to play a [serious game](https://en.wikipedia.org/wiki/Serious_game) on a physical board and have a camera detect the movement of pieces and automatically update the Cormas model. The game could then be stored, replayed, interacted with, and analysed using Cormas.\n\nObject detection can be implemented based on the smartphone camera or with a more advanced dedicated tool such as [Azure Kinect](https://azure.microsoft.com/en-us/products/kinect-dk/). Adaptation of Cormas platform for receiving live input from real world is a very important aspect of this project.",
"goal": "- Implement and test the API in Cormas for positioning agents on the spatial grid\n- Implement a prototype of an object detection system using computer vision\n- Connect the implemented object detection system to Cormas\n- Implement calibration and board initialization",
"description": "The current version of Cormas allows us to visualize the space and agents in the simulation using colors and geometric shapes (circles, rectangles, etc.). In this project, we want to add support for custom tilesets like the ones that are used in computer games. This would allow us to greatly improve the visual capabilities of Cormas by using custom pixel art. In Pharo, we already have support for sprites, which means that we know how to implement this project technically and can guide GSoC contributor in this. This project will require a lot of creativity because we expect contributor to propos a nice API and to build a collection of game tiles that can be used in Cormas.",
"goal": "- Add support for pixel art tilesets to Cormas\n- Propose a collection of default tiles and the methods for loading custom ones\n- Propose an API for configuring Cormas model to use a given tileset\n- Implement some of our existing models with tiles, and demonstrate them through videos and blog posts",
"keywords": [
"Computer Vision",
"Machine Learning",
"AI",
"Agent-Based Modeling"
"Visualization",
"Agent-base modelling",
"Games",
"Tilesets",
"Sprites",
"Pixel art"
],
"size": "Large",
"difficulty": "Hard",
"difficulty": "Medium",
"skills": {
"required": [
"Pharo",
"Machine Learing"
"Object-oriented programming"
],
"preferred": [
"Open CV",
"Cormas"
"Visualization",
"Art",
"Gaming"
]
}
},
{
"id": "moose-cormas",
"title": "Analysing Cormas Code with Moose",
"img": "nicolas-moose.png",
"id": "sound-effects",
"title": "Sound Effect Library for Agent-Based Simulations",
"img": "domenico-sound.jpeg",
"supervisors": [
"Nicolas Anquetil",
"Domenico Cipriani",
"Oleksandr Zaitsev"
],
"description": "[Moose](https://moosetechnology.org/) is a platform for software and data analysis implemented in Pharo. It provides an extensive toolkit for exploring the source code of a given project, find code defects, bad practices, etc. Cormas is a legacy software system that has been in development for more than 25 years. It has been migrated from one dialect of Smalltalk to another, it has been maintained by different people with different levels of expertise and different programming practices. As such, Cormas is a very interesting case study for code analysis. Using Moose, we can detect dead code (methods that are no longer used), split god classes and methods (the ones that are clearly too large), reorganize packages to reduce coupling, improve test coverage. All this information can be extremely valuable for Cormas development and it can also contribute to the improvement of Moose platform.",
"goal": "- Learn to use Moose (we have detailed guides and tutorials)\n- Load the source code of Cormas into Moose\n- Perform various analyses and build visualizations\n- Report the findings to the Cormas community\n- Improve the source code of Cormas",
"description": "In Pharo, there is a library for generating and synthesizing music. We want to use it to add sound effects to Cormas simulations. It will start with simple sound effects, for example, when a cow says Mooo or when walking of a grass makes a sound. Then we will explore to which extent a simulation can be perceived through sound. Can different scenarios (high energy / low energy) sound differntly? Can sounds help us understand simulations better? This is an innovative project that can have an important impact in the field participatory simulations by making our tools more accessible and more intuitive for people with disabilities and for the local stakeholders who do not have a technical background.",
"goal": "- Create simple sound effects in Pharo and release them as a library\n- Assign those sound effects to actions and events in Cormas simulations\n- Build an API for manipulating sounds in Cormas\n- Explore the patterns that emerge is a simulation through sound effects",
"keywords": [
"Code analysis",
"Code comprehension",
"Visualizations",
"Programming"
"Music",
"Agent-base modelling",
"Sound"
],
"size": "Medium",
"difficulty": "Easy",
"size": "Large",
"difficulty": "Medium",
"skills": {
"required": [
"Pharo",
"Object-oriented programming"
],
"preferred": [
"Cormas",
"Moose"
"C"
]
}
},
{
"id": "sound-effects",
"title": "Sound Effect Library for Agent-Based Simulations",
"img": "domenico-sound.jpeg",
"id": "moose-cormas",
"title": "Analysing Cormas Code with Moose",
"img": "nicolas-moose.png",
"supervisors": [
"Domenico Cipriani",
"Nicolas Anquetil",
"Oleksandr Zaitsev"
],
"description": "In Pharo, there is a library for generating and synthesizing music. We want to use it to add sound effects to Cormas simulations. It will start with simple sound effects, for example, when a cow says Mooo or when walking of a grass makes a sound. Then we will explore to which extent a simulation can be perceived through sound. Can different scenarios (high energy / low energy) sound differntly? Can sounds help us understand simulations better? This is an innovative project that can have an important impact in the field participatory simulations by making our tools more accessible and more intuitive for people with disabilities and for the local stakeholders who do not have a technical background.",
"goal": "- Create simple sound effects in Pharo and release them as a library\n- Assign those sound effects to actions and events in Cormas simulations\n- Build an API for manipulating sounds in Cormas\n- Explore the patterns that emerge is a simulation through sound effects",
"description": "[Moose](https://moosetechnology.org/) is a platform for software and data analysis implemented in Pharo. It provides an extensive toolkit for exploring the source code of a given project, find code defects, bad practices, etc. Cormas is a legacy software system that has been in development for more than 25 years. It has been migrated from one dialect of Smalltalk to another, it has been maintained by different people with different levels of expertise and different programming practices. As such, Cormas is a very interesting case study for code analysis. Using Moose, we can detect dead code (methods that are no longer used), split god classes and methods (the ones that are clearly too large), reorganize packages to reduce coupling, improve test coverage. All this information can be extremely valuable for Cormas development and it can also contribute to the improvement of Moose platform.",
"goal": "- Learn to use Moose (we have detailed guides and tutorials)\n- Load the source code of Cormas into Moose\n- Perform various analyses and build visualizations\n- Report the findings to the Cormas community\n- Improve the source code of Cormas",
"keywords": [
"Music",
"Agent-base modelling",
"Sound"
"Code analysis",
"Code comprehension",
"Visualizations",
"Programming"
],
"size": "Large",
"difficulty": "Medium",
"size": "Medium",
"difficulty": "Easy",
"skills": {
"required": [
"Pharo",
"Object-oriented programming"
],
"preferred": [
"Cormas",
"C"
"Moose"
]
}
},
{
"id": "game-tiles",
"title": "Adding Game Tiles and Sprites to Cormas",
"img": "game-tiles.png",
"id": "object-detection",
"title": "Computer Vision for Game Piece Detection",
"img": "computer vision.png",
"supervisors": [
"Milton Mamani Torres",
"Etienne Delay",
"Oleksandr Zaitsev"
],
"description": "The current version of Cormas allows us to visualize the space and agents in the simulation using colors and geometric shapes (circles, rectangles, etc.). In this project, we want to add support for custom tilesets like the ones that are used in computer games. This would allow us to greatly improve the visual capabilities of Cormas by using custom pixel art. In Pharo, we already have support for sprites, which means that we know how to implement this project technically and can guide GSoC contributor in this. This project will require a lot of creativity because we expect contributor to propos a nice API and to build a collection of game tiles that can be used in Cormas.",
"goal": "- Add support for pixel art tilesets to Cormas\n- Propose a collection of default tiles and the methods for loading custom ones\n- Propose an API for configuring Cormas model to use a given tileset\n- Implement some of our existing models with tiles, and demonstrate them through videos and blog posts",
"description": "The goal of this project is to enhance the interactive functionality of Cormas by building a computer vision system for detecting tangible objects such as board game pieces. Such a system would permit people to play a [serious game](https://en.wikipedia.org/wiki/Serious_game) on a physical board and have a camera detect the movement of pieces and automatically update the Cormas model. The game could then be stored, replayed, interacted with, and analysed using Cormas.\n\nObject detection can be implemented based on the smartphone camera or with a more advanced dedicated tool such as [Azure Kinect](https://azure.microsoft.com/en-us/products/kinect-dk/). Adaptation of Cormas platform for receiving live input from real world is a very important aspect of this project.",
"goal": "- Implement and test the API in Cormas for positioning agents on the spatial grid\n- Implement a prototype of an object detection system using computer vision\n- Connect the implemented object detection system to Cormas\n- Implement calibration and board initialization",
"keywords": [
"Visualization",
"Agent-base modelling",
"Games",
"Tilesets",
"Sprites",
"Pixel art"
"Computer Vision",
"Machine Learning",
"AI",
"Agent-Based Modeling"
],
"size": "Large",
"difficulty": "Medium",
"difficulty": "Hard",
"skills": {
"required": [
"Pharo",
"Object-oriented programming"
"Machine Learing",
"Computer Vision"
],
"preferred": [
"Visualization",
"Art",
"Gaming"
"Pharo",
"Python",
"PyTorch",
"YOLO"
"Open CV",
]
}
}
},
]
Binary file added data/img/computer-vision.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 25a8e32

Please sign in to comment.