Search results

(1 - 17 of 17)

Goedmakers, C.M.W. 2023

Outcome after anterior cervical discectomy: from inferential statistics to Machine Learning

Doctoral Thesis

some documents under embargo until 2025-09-21

After standard surgery for neck hernias, about 25% of patients report low satisfaction. This thesis applied inferential statistics to clinical data and Machine Learning to medical imaging, with the... Show moreAfter standard surgery for neck hernias, about 25% of patients report low satisfaction. This thesis applied inferential statistics to clinical data and Machine Learning to medical imaging, with the goal of finding out where differences in functional outcomes after surgery come from and how artificial intelligence can improve the diagnostic and prognostic process. The initial idea that differences in functional recovery were due to surgical technique was refuted by an RCT from this dissertation. The differences in functional recovery between three different surgical groups (removal of the intervertebral disc without artificial material, placement of intervertebral disc prosthesis, and fusion of vertebrae with a cage) were found to be minimal. It was striking that not surgical technique, but patients' mental health and preoperative, radiological imaging were found to be predictive of clinical recovery after surgery. Although the intervertebral disc prosthesis did not deliver on the promise of preserving mobility and thus could not prevent degeneration at adjacent levels, using Deep Learning based solely on the preoperative MRI of the neck, researchers were able to predict, among other things, which patients would require reoperation after surgery for that adjacent degeneration. The Deep Learning model did that significantly better than an experienced neuroradiologist and neurosurgeon. Such Deep Learning models eliminate the need for time-consuming questionnaires and are thus more cost-effective and less stressful for the patient, while they can be used to identify radiological features important for predicting the postoperative course. After validation with larger radiological datasets, these models can support clinical decision-making and help physicians develop personalized treatment strategies. Challenges within image analysis research for the spine lies in integrating different models into one automated process, preferably built into the electronic health record. Show less

Kurchaba, S.; Vliet, J. van; Verbeek, F.J.; Veenman, C.J. 2023

Anomalous NO2 emitting ship detection with TROPOMI satellite data and machine learning

Article / Letter to editor

open access

Starting from 2021, more demanding NOx emission restrictions were introduced for ships operating in the North and Baltic Sea waters. Since all methods currently used for ship compliance monitoring are financially and time demanding, it is important to prioritize the inspection of ships that have high chances of being non-compliant. The current state-of-the-art approach for a large-scale ship NO2 estimation is a supervised machine learning-based segmentation of ship plumes on TROPOMI/S5P images. However, challenging data annotation and insufficiently complex ship emission proxy used for the validation limit the applicability of the model for ship compliance monitoring. In this study, we present a methodology towards the automated and scalable selection of potentially non-compliant ships using a combination of machine learning models on TROPOMI satellite data. It is based on a proposed regression model predicting the amount of NO2 that is expected to be produced by a ship with certain properties operating in the given atmospheric conditions. The model does not require manual labeling and is validated with TROPOMI data directly. The differences between the predicted and actual amount of produced NO2 are integrated over observations of the ship in time and are used as a measure of the inspection worthiness of a ship. To add further evidence, we compare the obtained results with the results of the previously developed segmentation-based method. Ships that are also highly deviating in accordance with the segmentation method require further attention. If no other explanations can be found by checking the TROPOMI data, the respective ships are advised to be the candidates for inspection.

Show less

Moussa, C. 2023

Algorithm selection and configuration for Noisy Intermediate Scale Quantum methods for industrial applications

Doctoral Thesis

open access

Quantum hardware comes with a different computing paradigm and new ways to tackle applications. Much effort has to be put into understanding how to leverage this technology to give real-world... Show moreQuantum hardware comes with a different computing paradigm and new ways to tackle applications. Much effort has to be put into understanding how to leverage this technology to give real-world advantages in areas of interest for industries such as combinatorial optimization or machine learning. Variational quantum algorithms (VQAs) have been introduced as a way to work within the scope of reach of the current imperfect and unstable hardware. A VQA boils down to a parameterized quantum circuit, which is a quantum circuit with adjustable real-valued parameters. These parameters are generally tweaked by a classical optimization algorithm to optimize a quantity of interest. As VQAs are most often used as heuristics, it is not clear whether they genuinely outperform current classical state-of-the-art algorithms in relevant domains of application. Plus, a VQA can come with many components (which can also be calledhyperparameters) making it a (growing) complex system to analyze performances on many considered tasks. Consequently, we will face the issues of algorithm selection and configuration, which we tackle through this thesis on many examples relevant to industrial applications. In this thesis, VQAs for combinatorial optimization, chemistry/material science, and machine learning problems were considered. Show less

Ullah, S. 2023

Model-assisted robust optimization for continuous black-box problems

Doctoral Thesis

open access

Uncertainty and noise are frequently-encountered obstacles in real-world applications of numerical optimization. The practice of optimization that deals with uncertainties and noise is commonly... Show moreUncertainty and noise are frequently-encountered obstacles in real-world applications of numerical optimization. The practice of optimization that deals with uncertainties and noise is commonly referred to as robust optimization. This thesis concentrates on robust optimization w.r.t the parametric uncertaintiesin the search variables. These parametric uncertainties are assumed to be structurally symmetric, additive in nature, and can be modeled in a deterministic or aprobabilistic fashion. This dissertation empirically studies the models, algorithms, and techniques utilized for surrogate-assisted robust optimization in this context. Based on the studies performed in the dissertation, we conclude that Kriging, SVM, and Polynomial Regression are useful modeling techniques to solve robust optimization problems. We also validate the applicability of Autoencoders and PCA for addressing high-dimensional problems. Lastly, we find that mini-max robustness is the most efficient robustness formulation technique in practical scenarios. Show less

Sbrollini, A.; Barocci, M.; Mancinelli, M.; Paris, M.; Raffaelli, S.; Marcantoni, I.; ... ; Burattini, L. 2023

Automatic diagnosis of newly emerged heart failure from serial electrocardiography by repeated structuring & learning procedure

Article / Letter to editor

open access

Heart failure (HF) diagnosis, typically visually performed by serial electrocardiography, may be supported by machine-learning approaches. Repeated structuring & learning procedure (RS & LP... Show moreHeart failure (HF) diagnosis, typically visually performed by serial electrocardiography, may be supported by machine-learning approaches. Repeated structuring & learning procedure (RS & LP) is a constructive algorithm able to automatically create artificial neural networks (ANN); it relies on three parameters, namely maximal number of hidden layers (MNL), initializations (MNI) and confirmations (MNC), arbitrarily set by the user. The aim of this study is to evaluate RS & LP robustness to varying values of parameters and to identify an optimized combination of parameter values for HF diagnosis. To this aim, the Leiden University Medical Center HF data-base was used. The database is constituted by 129 serial ECG pairs acquired in patients who experienced myocardial infarction; 48 patients developed HF at follow-up (cases), while 81 remained clinically stable (controls). Overall, 15 ANNs were created by considering 13 serial ECG features as inputs (extracted from each serial ECG pair), 2 classes as outputs (cases/controls), and varying values of MNL (1, 2, 3, 4 and 10), MNI (50, 250, 500, 1000 and 1500) and MNC (2, 5, 10, 20 and 50). The area under the curve (AUC) of the receiver operating characteristic did not significantly vary with varying parameter values (P >= 0.09). The optimized combination of parameter values, identified as the one showing the highest AUC, was obtained for MNL = 3, MNI = 500 and MNC = 50 (AUC = 86 %; ANN structure: 3 hidden layers of 14, 14 and 13 neurons, respectively). Thus, RS & LP is robust, and the optimized ANN represents a potentially useful clinical tool for a reliable auto-matic HF diagnosis. Show less

Pratiwi Bunga, C.; Dusseldorp, E.; Karch, J.D.; de Rooij, M. 2023

Predictive performance of psychological tests: is it better to use items than subscales?

Article / Letter to editor

open access

Thomson, S.L.; Stein, N. van; Berg, D. van den; Leeuwen, C. van 2023

The opaque nature of intelligence and the pursuit of explainable AI

Article in monograph or in proceedings

open access

Wardenaar, K.J.; Riese, H.; Giltay, E.J.; Eikelenboom, M.; Hemert, A.J. van; Beekman, A.F.; ... ; Schoevers, R.A. 2021

Common and specific determinants of 9-year depression and anxiety course-trajectories: a machine-learning investigation in the Netherlands Study of Depression and Anxiety (NESDA)

Article / Letter to editor

open access

Background: Given the strong relationship between depression and anxiety, there is an urge to investigate their shared and specific long-term course determinants. The current study aimed to... Show moreBackground: Given the strong relationship between depression and anxiety, there is an urge to investigate their shared and specific long-term course determinants. The current study aimed to identify and compare the main determinants of the 9-year trajectories of combined and pure depression and anxiety symptom severity. Methods: Respondents with a 6-month depression and/or anxiety diagnosis (n=1,701) provided baseline data on 152 sociodemographic, clinical and biological variables. Depression and anxiety symptom severity assessed at baseline, 2-, 4-, 6- and 9-year follow-up, were used to identify data-driven course-trajectory subgroups for general psychological distress, pure depression, and pure anxiety severity scores. For each outcome (classprobability), a Superlearner (SL) algorithm identified an optimally weighted (minimum mean squared error) combination of machine-learning prediction algorithms. For each outcome, the top determinants in the SL were identified by determining variable-importance and correlations between each SL-predicted and observed outcome (rho pred) were calculated. Results: Low to high prediction correlations (rho pred: 0.41-0.91, median=0.73) were found. In the SL, important determinants of psychological distress were age, young age of onset, respiratory rate, participation disability, somatic disease, low income, minor depressive disorder and mastery score. For course of pure depression and anxiety symptom severity, similar determinants were found. Specific determinants of pure depression included several types of healthcare-use, and of pure-anxiety course included somatic arousal and psychological distress. Limitations: Limited sample size for machine learning. Conclusions: The determinants of depression- and anxiety-severity course are mostly shared. Domain-specific exceptions are healthcare use for depression and somatic arousal and distress for anxiety-severity course. Show less

Wall, H.E.C. van der; Doll, R.J.; Westen, G.J.P. van; Koopmans, I.; Zuiker, R.G.; Burggraaf, J.; Cohen, A.F. 2021

Using machine learning techniques to characterize sleep-deprived driving behavior

Article / Letter to editor

open access

OBJECTIVESleep deprivation is known to affect driving behavior and may lead to serious car accidents similar to the effects from e.g., alcohol. In a previous study, we have demonstrated that the... Show moreOBJECTIVESleep deprivation is known to affect driving behavior and may lead to serious car accidents similar to the effects from e.g., alcohol. In a previous study, we have demonstrated that the use of machine learning techniques allows adequate characterization of abnormal driving behavior after alprazolam and/or alcohol intake. In the present study, we extend this approach to sleep deprivation and test the model for characterization of new interventions. We aimed to classify abnormal driving behavior after sleep deprivation, and, by using a machine learning model, we tested if this model could also pick up abnormal driving behavior resulting from other interventions.METHODSData were collected during a previous study, in which 24 subjects were tested after being sleep-deprived and after a well-rested night. Features were calculated from several driving parameters, such as the lateral position, speed of the car, and steering speed. In the present study, we used a gradient boosting model to classify sleep deprivation. The model was validated using a 5-fold cross validation technique. Next, probability scores were used to identify the overlap of driving behavior after sleep deprivation and driving behavior affected by other interventions. In the current study alprazolam, alcohol, and placebo are used to test/validate the approach.RESULTSThe sleep deprivation model detected abnormal driving behavior in the simulator with an accuracy of 77 ± 9%. Abnormal driving behavior after alprazolam, and to a lesser extent also after alcohol intake, showed remarkably similar characteristics to sleep deprivation. The average probability score for alprazolam and alcohol measurements was 0.79, for alcohol 0.63, and for placebo only 0.27 and 0.30, matching the expected relative drowsiness.CONCLUSIONWe developed a model detecting abnormal driving induced by sleep deprivation. The model shows the similarities in driving characteristics between sleep deprivation and other interventions, i.e., alcohol and alprazolam. Consequently, our model for sleep deprivation may serve as a next reference point for a driving test battery of newly developed drugs. Show less

Bruin, G.J. de; Veenman, C.J.; Herik, H.J. van den; Takes, F.W. 2021

Experimental evaluation of train and test split strategies in link prediction

Article in monograph or in proceedings

open access

In link prediction, the goal is to predict which links will appear in the future of an evolving network. To estimate the performance of these models in a supervised machine learning model, disjoint... Show moreIn link prediction, the goal is to predict which links will appear in the future of an evolving network. To estimate the performance of these models in a supervised machine learning model, disjoint and independent train and test sets are needed. However, objects in a real-world network are inherently related to each other. Therefore, it is far from trivial to separate candidate links into these disjoint sets.Here we characterize and empirically investigate the two dominant approaches from the literature for creating separate train and test sets in link prediction, referred to as random and temporal splits. Comparing the performance of these two approaches on several large temporal network datasets, we find evidence that random splits may result in too optimistic results, whereas a temporal split may give a more fair and realistic indication of performance. Results appear robust to the selection of temporal intervals. These findings will be of interest to researchers that employ link prediction or other machine learning tasks in networks. Show less

Barrientos, A.; Holdship, J.R.; Solar, M.; Martín, S.; Rivilla, V.M.; Viti, S.; ... ; Humire, P. 2021

Towards the prediction of molecular parameters from astronomical emission lines using Neural Networks

Article / Letter to editor

open access

Sears, A.M. 2020

Algorithmic speech and freedom of expression

Article / Letter to editor

open access

Algorithms have become increasingly common, and with this development, so have algorithms that approximate human speech. This has introduced new issues with which courts and legislators will have... Show moreAlgorithms have become increasingly common, and with this development, so have algorithms that approximate human speech. This has introduced new issues with which courts and legislators will have to grapple. Courts in the United States have found that search engine results are a form of speech that is protected by the Constitution, and cases in Europe concerning liability for autocomplete suggestions have led to varied results. Beyond these instances, insight into how courts handle algorithmic speech are few and far between.By focusing on three categories of algorithmic speech, defined as curated production, interactive/responsive production, and semiautonomous production, this Article analyzes these various forms of algorithmic speech within the international framework for freedom of expression. After a brief introduction of that framework and a look towards approaches to algorithmic speech in the United States, the Article then examines whether the creators or controllers of different forms of algorithms should be considered content providers or mere intermediaries, the determination of which ultimately has implications for liability, which is also explored. The Article then looks at possible interferences with algorithmic speech, and how such interferences may be examined under the three-part test—particular attention is paid to the balancing of rights and interests at play—in order to answer the question of the extent to which algorithmic speech is worthy of protection under international standards of freedom of expression. Finally, other relevant issues surrounding algorithmic speech are discussed that will have an impact going forward, many of which involve questions of policy and societal values that accompany granting algorithmic speech protection. Show less

Echtenbruck, M.M. 2020

Optimally weighted ensembles of surrogate models for sequential parameter optimization

Doctoral Thesis

open access

It is a common technique in global optimization with expensive black-box functions to learn a surrogate-model of the response function from past evaluations and use it to decide on the location of... Show moreIt is a common technique in global optimization with expensive black-box functions to learn a surrogate-model of the response function from past evaluations and use it to decide on the location of future evaluations.In surrogate-model-assisted optimization, selecting the right modeling technique without preliminary knowledge about the objective function can be challenging. It might be beneficial if the algorithm trains many different surrogate models and selects the model with the smallest training error. This approach is known as model selection.In this thesis, a generalization of this approach is developed. Instead of choosing a single model, the optimal convex combinations of model predictions is used to combine surrogate models into one more accurate ensemble surrogate model.This approach is studied in a fundamental way, by first evaluating minimalistic ensembles of only two surrogate models in detail and then proceeding to ensembles with more surrogate models.Finally, the approach is adopted and evaluated in the context of sequential parameter optimization. Besides discussing the general strategy, the optimal frequency of learning the convex combination of weights is investigated.The results provide insights into the performance, scalability, and robustness of the approach. Show less

Shan, H. 2020

Towards high performance and efficient brain computer interface character speller : convolutional neural network based methods

Doctoral Thesis

open access

A P300-based Brain Computer Interface character speller, also known as P300 speller, has been an important communication pathway, under extensive research, for people who lose motor ability, such... Show moreA P300-based Brain Computer Interface character speller, also known as P300 speller, has been an important communication pathway, under extensive research, for people who lose motor ability, such as patients with Amyotrophic Lateral Sclerosis or spinal-cord injury because a P300 speller allows human-beings to directly spell characters using eye-gazes, thereby building communication between the human brain and a computer. Unfortunately, P300 spellers are still not used in human’s daily life and remain in an experimental stage at research labs. The reason for this situation is that the performance and the efficiency of current P300 spellers are unacceptably low for BCI users in their daily life. Therefore, in this thesis, we have focused our attention on developing high performance and efficient P300 spellers in order to bring P300 spellers into practical use. More specifically, in order to increase the performance of a P300 speller, we have developed methods to increase the character spelling accuracy and the Information Transfer Rate. In order to improve the efficiency of a P300 speller, we have developed methods to reduce the number of sensors needed to acquire EEG signals as well as to reduce the complexity of the classifier used in a P300 speller without losing the performance. Show less

Marchetti, T. 2019

Hunting for the fastest stars in the Milky Way

Doctoral Thesis

open access

The high velocity tail of the total velocity distribution of stars provides essential insight into fundamental properties of the Galaxy. Hypervelocity stars (HVSs), travelling on unbound orbits... Show moreThe high velocity tail of the total velocity distribution of stars provides essential insight into fundamental properties of the Galaxy. Hypervelocity stars (HVSs), travelling on unbound orbits coming from the Galactic Centre, are powerful tracers of the underlying Galactic gravitational potential, and can shed light on the stellar population in the proximity of our massive black hole. Runaway stars, ejected from the stellar disk, provide information on binary evolution and stellar clusters' dynamical processes. The advent of the data from the European Space Agency satellite Gaia has revolutionized our knowledge on high velocity stars. In my PhD thesis entitled "Hunting for the fastest stars in the Milky Way" I present my work on searching for the fastest stars in the Milky Way. I start by presenting our modelling work on predicting the HVS population expected to be contained in the Gaia catalogue. Then I illustrate the data mining techniques built and implemented to find these rare objects in the first and second data release of Gaia. Finally, I conclude discussing how HVSs can be used to constrain the Galactic dark matter halo and the binary population in the Galactic Centre. Show less

De Gouveia da Costa Cachucho, R.E. 2018

Methods and tools for mining multivariate time series

Doctoral Thesis

open access

Mining time series is a machine learning subfield that focuses on a particular data structure, where variables are measured over (short or long) periods of time. In this thesis we focus on... Show moreMining time series is a machine learning subfield that focuses on a particular data structure, where variables are measured over (short or long) periods of time. In this thesis we focus on multivariate time series, with multiple vari- ables measured over the same period of time. In most cases, such variables are collected at different sampling rates. When combined, these variables can be explored with machine learning methods for multiple purposes.Firstly, we consider the possibility of unsupervised learning. In this case, we propose a pattern recognition method that discovers subsets of variables that show consistent behavior in a number of shared time segments. Fur- thermore, when in a supervised setting, given a dependent variable (target),we propose a method that aggregates independent variables into meaningful features.Additionally to the methods above, we provide two tools in the form of Software as a Service, where users without programming background can intuitively follow the learning and testing methodologies for both methods.Finally, we present an applied study of machine learning to improve speed skating athletes performance. Here, we make a deep analysis of historical data, in order to help optimize performance results. Show less

Nijssen, Siegfried Gerardus Remius 2006

Mining Structured Data

Doctoral Thesis

open access

Many databases do not consist of a single table of fixed dimensions, but of objects that are related to each other: the databases are relational, or structured. We study the discovery of patterns... Show moreMany databases do not consist of a single table of fixed dimensions, but of objects that are related to each other: the databases are relational, or structured. We study the discovery of patterns in such data. In our approach, a data analyst specifies constraints on patterns that she believes to be of interest, and the computer searches for patterns that satisfy these constraints. An important constraint on which we focus, is the constraint that a pattern should have a significant number of occurrences in the data. Constraints like this allow the search to be performed reasonably efficiently. We develop algorithms for searching ppatterns taht are represented in formal first order logic, tree data structures and graph data structures. We perform experiments in which these algorithms, and algorithms proposed by other researchers, are compared with each other, and study which properties determine the efficiency of the algorithms. As a result, we are able to develop more efficient algorithms. As application we study the discovery of fragments in molecular datasets. The aim is to discover fragments that relate the structure of molecules to their activity. Show less

Leiden University Scholarly Publications

Your Search

Enabled Filters

Sort Options

Refine Results

Resource Type

Availability

Creation Date

Faculty

Collection

Topic

Author

Language

Search results