BAT-Framework: a framework to compare text-annotators

Day - Time: 01 February 2013, h.11:00

Place: Area della Ricerca CNR di Pisa - Room: C-29

Google ics

Share with Whatsapp

Share with Telegram

Send by email

Speakers

Marco Cornolti (Dipartimento di Informatica, Università di Pisa)

Referent

Fabrizio Sebastiani

Abstract

We have implemented a benchmarking framework for fair and exhaustive comparison of entity-annotation systems. The framework is based upon the definition of a set of problems related to the entity-annotation task (which formalize the primary issues arising in this task), a set of measures to evaluate systems performance, and the inclusion of all publicly available datasets, containing texts of various types: news, tweets and Web pages. Our framework is easily-extensible with novel entity annotators, datasets and evaluation measures for comparing systems, and it will be released to the public. The intent of this framework is to set the ground for further developments in this challenging task, being a basis on which new annotators can be developed.

Latest Announcements

Seminars

Giovani in un'ora - Ciclo di seminari - Quinta parte

2024-11-27

Giulio Del Corso - "Generating a physically accurate cardiac MRI: a story of (interesting) failures and (justifiable) numerical shortcuts"Abstract: "The generation of physically accurate cardiac-MRI video sequences is a challenging topic that requires a combination of modern g...

Room: C-29

Seminars

Giovani in un'ora - Ciclo di seminari - Quarta parte

2024-11-20

Luca Ciampi - "Mind the Prompt: A Novel Benchmark for Prompt-based Class-Agnostic Counting"Abstract: "Object counting estimates the number of objects in images or video frames. Studies reveal that the human brain employs two distinct methods for counting objects owing to the s...

Room: C-29

Seminars

Giovani in un'ora - Ciclo di seminari - Terza parte

2024-10-16

Gabriele Lagani - "Hebbian learning algorithms for deep neural networks: explorations and outlooks"Abstract: Deep learning systems have achieved outstanding results in various AI tasks. However, such system suffer from a number of limitations, for example in terms of energy an...

Room: C-29

Seminars

Giovani in un'ora - Ciclo di seminari - Seconda parte

2024-10-09

Saira Bano - "From Complexity to Clarity: Enhancing Cross-Modal Knowledge Distillation via Multimodal Teacher Ensembles"Abstract: Traditional knowledge distillation (KD) typically uses a large, complex teacher model, often trained to a single modality, to transfer knowledge to...

Room: C-29

Seminars

Patient Interaction – for well-being, productivity and sustainability

2024-10-08

We live in aworld of instant results and fleeting gratification. In HCI no less: the designprinciples for direct manipulation require immediate feedback and, in the caseof graphical actions, sub-second responses. In addition, computers expect us togive them our undivided atten...

Room: Aula Faedo C-29

Seminars

Giovani in un'ora - Ciclo di seminari - Prima parte

2024-10-02

Ali Reza Omrani - "Machine Learning to Measure Vocal Stereotypy: An Extension"Abstract: Repeated measurement of behavior is a process central to behavior analysis, but its implementation occasionally requires hiring observers dedicated exclusively to data collection, which may...

Room: C-29

Seminars

A general framework for distributed approximate similarity search with arbitrary distances

2024-09-26

While many similarity search algorithms are specifically adapted to metric distances,they are unsuitable for alternatives like the cosine distance, which has gained popularity, particularly with embeddings and text mining. To address thisissue, we propose GDASC (General Distri...

Room: C-29

Seminars

Model-Driven Engineering Meets Model-Based Testing

2024-09-17

In this talk, I will focus on a connection between stable-failures refinement and the ioco conformance relation. Both behavioural relations underlie methodologies that have gained traction in industry: stable-failures refinement is used in several commercial Model-Driven Engin...

Room: Faedo (C-29)

Seminars

Explainability in deep learning models applied to spatio-temporal problems

2024-09-13

Artificial Intelligence (AI) is transforming society, affecting everything from industry to decision making, and concerns about its transparency have increased. Explainable Artificial Intelligence (XAI) is crucial to address this problem, allowing to obtain a better understand...

Room: C-29

Seminars

Making 5G Networks Reliable for Next-generation Applications using AI

2024-05-27

The emergence of 5G technology marks a significant milestone in developing telecommunication networks, enabling exciting new applications such as augmented reality and self-driving vehicles. However, these improvements bring an increased management complexity and a special con...

Room: C-29