Luca Bacco
  • Home
  • Publications
  • CV
    • Short CV
    • Academic CV
ESC

Searching...

No results found

↑↓ Navigate ↵ Select
Powered by Hugo Blox
  • News
    • Chairing at MEDICON 2026 on September 17
    • Eight papers accepted at MEDICON 2026
    • AIME 2026 in Ottawa
  • Publications
    • A Multimodal Wearable Framework for Predicting Epileptic Seizures
    • Artificial intelligence based intervertebral discs grading: From unsupervised detection to explainable Pfirrmann classification
    • Benchmarking Automatic Question Generation from Clinical Practice Guidelines for Education: a Case Study for Low Back Pain Management
    • Deep Learning-Based Coronary Artery Segmentation for the Comparison of CCTA Reconstruction Methods
    • Discriminative and predictive power of radiomics features from preoperative MRI studies in patients with supraspinatus lesions
    • ECG-Based Non-Invasive Glycaemic Estimation in Type 1 Diabetes
    • Edge Computer Vision for Arboviruses Vectors and Global Health Surveillance
    • How technologies are driving digital innovation in mosquito surveillance systems: a global scoping review over the past decade
    • Lightweight Multimodal Deep Learning for Continuous Respiratory Rate Estimation from ECG and PPG
    • Multi-View Lumbar MRI for Therapy-Oriented Decision Support System in Low Back Pain
    • Neural Pathway Similarity Analysis for Efficient Glycemic Event Prediction
    • On the Evaluation of Biomedical Text Simplification Datasets: A Benchmarking Study
    • Performance of Different Wearable Sensor Configurations in Sleep/Wake Classification with and without Apnoea Events
    • Preoperative Radiomic Biomarkers Reflect Functional Shoulder Impairment in Rotator Cuff Tears: A Structure--Function Analysis
    • A GARCH-temporal fusion transformer model for the volatility prediction of exchange traded funds
    • A Novel Real-World Dataset of Italian Clinical Notes for NLP-based Decision Support in Low Back Pain Treatment
    • A Prediction of Drugs Transport, Distribution and Absorption by a Multicompartmental Physiologically-Based Pharmacokinetic Model
    • Adopting Machine Learning to Predict Breast Cancer Patients Adherence with Lifestyle Recommendations and Quality of Life Outcomes
    • Cross-Lingual Distillation for Domain Knowledge Transfer with Sentence Transformers
    • Doctor, Is That You? Evaluating Large Language Models on Italy's Medical School Entrance Exams
    • Efficient Multi-Task Learning with Instance Selection for Biomedical NLP
    • Feature-Based Knowledge Distillation for Explainable Detection of Pulmonary Diseases
    • Price Variations in Food Products: A Time Series Dataset for Analysis Across Regions in Italian Supermarkets
    • From Pre-training to Fine-tuning: an in-depth Analysis of Large Language Models in the Biomedical Domain
    • Investigating Stock Prediction Using LSTM Networks and Sentiment Analysis of Tweets Under High Uncertainty: A Case Study of North American and European Banks
    • Quantifying Treatments as Usual and with Technologies in Neurorehabilitation of Individuals with Spinal Cord Injury
    • A Text Style Transfer System for Reducing the Physician-Patient Expertise Gap: an Analysis with Automatic and Human Evaluations
    • Advancing ECG Biometrics through Vision Transformers: A Confidence-Driven Approach
    • Layered meta-learning Algorithm for Predicting Adverse Events in Type 1 Diabetes
    • Natural Language Processing in Healthcare: a Bird's Eye View
    • On the Instability of Further Pre-Training: Does a Single Sentence Matter to BERT?
    • Photoplethysmographic Signal Quality Assessment: a Comparative Study of Unsupervised and Supervised Neural Networks
    • Postural Data Analysis using AI-powered Classification Models
    • Artificial Intelligence and Computer Aided Diagnosis in Chronic Low Back Pain: A Systematic Review
    • Machine Learning analysis of High-Grade Serous Ovarian Cancer proteomic dataset reveals novel candidate biomarkers
    • Natural language processing in low back pain and spine diseases: A systematic review
    • Explainable Sentiment Analysis: A Hierarchical Transformer-Based Extractive Summarization Approach
    • Extractive Summarization for Explainable Sentiment Analysis using Transformers
    • Single beat ECG-based Identification System: development and robustness test in different working conditions
    • The impact of the intestinal microbiota and the mucosal permeability on three different antibiotic drugs
    • A Machine Learning approach for Sentiment Analysis for Italian Reviews in Healthcare
  • Courses
    • Hugo Blox
      • Getting Started
      • Guide
        • Project Structure
        • Configuration
        • Formatting
          • Embed Media
          • Buttons
          • Callouts
          • Cards
          • Spoilers
          • Steps
      • Reference
        • Customization
        • Internationalization (i18n)
  • Blog
    • ⚡️ Turn Jupyter Notebooks into Blog Posts
    • 🎉 Easily create your own simple yet highly customizable blog
    • 🧠 Sharpen your thinking with a second brain
    • 📈 Communicate your results effectively with the best data visualizations
    • 👩🏼‍🏫 Teach academic courses
    • ✅ Manage your projects
  • Projects
    • Pandas
    • PyTorch
    • scikit-learn
  • Slides
    • Example Talk: Recent Work
  • Experience
  • Recent & Upcoming Talks
    • Create Beautiful Presentations with Markdown

On the Instability of Further Pre-Training: Does a Single Sentence Matter to BERT?

Jan 1, 2023·
L. Bacco
,
G. Minnema
,
T. Caselli
,
F. Dell'Orletta
,
M. Merone
,
M. Nissim
· 0 min read
URL DOI
Type
Journal article
Publication
Natural Language Processing Journal
publications
Last updated on Jan 1, 2023
← Natural Language Processing in Healthcare: a Bird's Eye View Jan 1, 2023
Photoplethysmographic Signal Quality Assessment: a Comparative Study of Unsupervised and Supervised Neural Networks Jan 1, 2023 →

© 2026 Università Campus Bio-Medico di Roma. This work is licensed under CC BY NC ND 4.0

Made with Hugo Blox Kit. Clone this template →

Luca Bacco

Luca Bacco

Assistant Professor & AI Research Scientist

Università Campus Bio-Medico di Roma

Rome, Italy