In recent years, the Metaverse has sparked an increasing interest across the globe and is projected to reach a market size of more than $1000B by 2030. This is due to its many potential applications in highly heterogeneous fields, such as entertainment and multimedia consumption, training, and industry. This new technology raises many research challenges since, as opposed to the more traditional scene understanding, metaverse scenarios contain additional multimedia content, such as movies in virtual cinemas and operas in digital theaters, which greatly influence the relevance of the metaverse to a user query. For instance, if a user is looking for Impressionist exhibitions in a virtual museum, only the museums that showcase exhibitions featuring various Impressionist painters should be considered relevant.
We introduce the novel problem of text-to-metaverse retrieval, to support the users in finding the most suitable metaverse according to a given textual query. It is a challenging task, since the multimedia content present in the metaverse greatly influences its relevance to the user query.
Important news:
- We are hosting the Metaverse Apartment Retrieval Challenge! Running from March 25 to July 30!
- We are organizing the 3rd edition of the CV4Metaverse Workshop at ECCV 2024 alongside Maria Pegia (Reykjavik University), Barbara Rössle (Technical University of Munich), Bichen Wu (Meta), Peter Vajda (Meta), Richard Zhang (Amazon and Simon Fraser University)! Head to the website for more information about the Call for Paper (deadline July 19).
Related publications:
- Ali Abdari, Alex Falcon, Giuseppe Serra. AdOCTeRA: Adaptive optimization constraints for improved text-guided retrieval of apartments. ACM International Conference on Multimedia Retrieval (ICMR), 2024. [pdf soon] [DOI soon]
- Alex Falcon, Beatrice Portelli, Ali Abdari, Giuseppe Serra. Paving the Way for Personalized Museums Tours in the Metaverse. 20th conference on Information and Research science Connecting to Digital and Library science (IRCDL), 2024. [pdf]
- Ali Abdari, Alex Falcon, Giuseppe Serra. A Language-based solution to enable Metaverse Retrieval. 30th International Conference on Multimedia Modeling (MMM), 2024. [pdf] [DOI]
- Ali Abdari, Alex Falcon, Giuseppe Serra. FArMARe: a Furniture-Aware Multi-task methodology for Recommending Apartments based on the user interests. IEEE/CVF International Conference on Computer Vision – Computer Vision for Metaverse Workshop (ICCV), 2023. [pdf] [DOI]
- Ali Abdari, Alex Falcon, Giuseppe Serra. Metaverse Retrieval: Finding the Best Metaverse Environment via Language. ACM International Conference on Multimedia – Deep Multimodal Learning for Information Retrieval Workshop (ACM MM MMIR), 2023. [pdf] [DOI]
Research group:
- Ali Abdari (AILAB-Udine Member)
- Alex Falcon (AILAB-Udine Member)
- Giuseppe Serra (AILAB-Udine Member)