AIMC Topic: Markov Chains

Clear Filters Showing 81 to 90 of 288 articles

Dynamic risk stratification using Markov chain modelling in patients with chronic heart failure.

ESC heart failure
AIMS: Risk changes with the progression of disease and the impact of treatment. We developed a dynamic risk stratification Markov chain model using artificial intelligence in patients with chronic heart failure (CHF).

General Decay Stability for Nonautonomous Neutral Stochastic Systems With Time-Varying Delays and Markovian Switching.

IEEE transactions on cybernetics
A new type of asymptotic stability for nonlinear hybrid neutral stochastic systems with constant delays was investigated recently, where the criteria depended on the delays' sizes. Unfortunately, developed theory so far is not sufficient to deal with...

Finite-frequency control for nonlinear semi-Markov jump systems with piecewise transition probabilities.

ISA transactions
Considering the frequency effect of external disturbances, this paper concerns the finite-frequency control problem for nonlinear semi-Markov jump systems (SMJSs) with piecewise transition probabilities (TPs) via the Takagi-Sugeno (T-S) fuzzy modelin...

A Hybrid Approach for Approximating the Ideal Observer for Joint Signal Detection and Estimation Tasks by Use of Supervised Learning and Markov-Chain Monte Carlo Methods.

IEEE transactions on medical imaging
The ideal observer (IO) sets an upper performance limit among all observers and has been advocated for assessing and optimizing imaging systems. For general joint detection and estimation (detection-estimation) tasks, estimation ROC (EROC) analysis h...

Deep Reinforcement Learning With Modulated Hebbian Plus Q-Network Architecture.

IEEE transactions on neural networks and learning systems
In this article, we consider a subclass of partially observable Markov decision process (POMDP) problems which we termed confounding POMDPs. In these types of POMDPs, temporal difference (TD)-based reinforcement learning (RL) algorithms struggle, as ...

Asynchronous Distributed Finite-Time H Filtering in Sensor Networks With Hidden Markovian Switching and Two-Channel Stochastic Attack.

IEEE transactions on cybernetics
This article investigates the asynchronous distributed finite-time H filtering problem for nonlinear Markov jump systems over sensor networks under stochastic attacks. The stochastic attacks, called two-channel deception attacks, exist not only betwe...

Appointment Scheduling Problem in Complexity Systems of the Healthcare Services: A Comprehensive Review.

Journal of healthcare engineering
This paper provides a comprehensive review of Appointment Scheduling (AS) in healthcare service while we propose appointment scheduling problems and various applications and solution approaches in healthcare systems. For this purpose, more than 150 s...

Event-Triggered Output Feedback Synchronization of Master-Slave Neural Networks Under Deception Attacks.

IEEE transactions on neural networks and learning systems
The problem of event-triggered synchronization of master-slave neural networks is investigated in this article. It is assumed that both communication channels from the sensor to controller and from controller to actuator are subject to stochastic dec...

IDNetwork: A deep illness-death network based on multi-state event history process for disease prognostication.

Statistics in medicine
Multi-state models can capture the different patterns of disease evolution. In particular, the illness-death model is used to follow disease progression from a healthy state to an intermediate state of the disease and to a death-related final state. ...

Reachable Set Estimation for Markovian Jump Neutral-Type Neural Networks With Time-Varying Delays.

IEEE transactions on cybernetics
The reachable set estimation problem for a class of Markovian jump neutral-type neural networks (MJNTNNs) with bounded disturbances and time-varying delays is tackled in this article. With the aid of the delay partitioning method, a novel stochastic ...