[특허]Stable adaptive control using critic designs

Stable adaptive control using critic designs 원문보기

IPC분류정보
국가/구분	United States(US) Patent 등록
국제특허분류(IPC7판)	G06F-015/18
출원번호	US-0404197 (1999-09-23)
발명자 / 주소	Werbos, Paul J.
대리인 / 주소	Oblon, Spivak, McClelland, Maier & Neustadt, P.C.
인용정보	피인용 횟수 : 78 인용 특허 : 0

초록 ▼

Classical adaptive control proves total-system stability for control of linear plants, but only for plants meeting very restrictive assumptions. Approximate Dynamic Programming (ADP) has the potential, in principle, to ensure stability without such tight restrictions. It also offers nonlinear and neural extensions for optimal control, with empirically supported links to what is seen in the brain. However, the relevant ADP methods in use today--TD, HDP, DHP, GDHP--and the Galerkin-based versions of these all have serious limitations when used here as parallel distributed real-time learning systems. Either they do not possess quadratic unconditional stability or they lead to incorrect results in the stochastic case. (ADAC or Q-learning designs do not help.) The present invention describes new ADP designs which overcome these limitations. It also addresses the Generalized Moving Target problem, a common family of static optimization problems, and describes a way to stabilize large-scale economic equilibrium models, such as the old long-term energy model of DOE.

대표청구항 ▼

1. In a computer program product including a computer storage medium, the improvement comprising a computer program code mechanism embedded in the computer storage medium for causing a microprocessor to implement a heuristic dynamic programming controller controlling an external system, the computer program code mechanism comprising: a first computer code device configured to train a deterministic forecasting model f'(R(t)) to predict the expectation value of R(t+1); a second computer code device configured to calculate an error function, e, based on sampled value of J(t+1); and a third computer code device configured to calculate ∇te' by backpropagating through: e'=(J(R(t,W)-(J(f'(R(t)),W)+U)) such that tW>=-∇te'. 2. In the computer program product as claimed in claim 1, the improvement further comprising: a fourth code device configured to calculate: ΔW=-2αe(∇te')=2αe(∇J(R(t))-(I/(1+r))∇J(f'(R(t))). 3. In a computer program product including a computer storage medium, the improvement comprising a computer program code mechanism embedded in the computer storage medium for causing a microprocessor to implement a heuristic dynamic programming controller controlling an external system, the computer program code mechanism comprising: a first computer code device configured to train a deterministic forecasting model f'(R(t)) to predict the expectation value of R(t+1); a second computer code device configured to obtain a value R(t+1) at each time t+1; a third computer code device configured to backpropagated an error, e, through J(R(t+1)) back to weights of a critic network; a fourth computer code device configured to obtain a first set of derivatives, g1, representing a gradient of e with respect to the weights of the critic network; a fifth computer code device configured to backpropagate e' through J(f'(R(t)), back to the weights of the Critic network to form a second set of derivatives g2; and a sixth computer code device configured to adapt weights of f' so as to minimize: Eg=|g1-g2|2. 4. In the computer program product as claimed in claim 3, wherein the second computer code device further comprises a seventh computer code device configured to obtain R(t+1) by simulating a random vector w inserted into a stochastic model f(R(t),w). 5. In the computer program product as claimed in claim 3, wherein the second computer code device further comprises a seventh computer code device configured to obtain R(t+1) by actually observing R(t+1) and estimating w.

이 특허를 인용한 특허 (78)

Ahmed, Ghufran; Ferik, Sami El, Adaptive control method for unmanned vehicle with slung load.
상세보기
Calise, Anthony J.; Hovakimyan, Naira; Idan, Moshe, Adaptive control system having direct output feedback and related apparatuses and methods.
상세보기
Calise,Anthony J.; Hovakimyan,Naira; Idan,Moshe, Adaptive control system having direct output feedback and related apparatuses and methods.
상세보기
Ponulak, Filip, Adaptive critic apparatus and methods.
상세보기
Koike,Shinichi, Adaptive filter employing adaptively controlled forgetting factor and adaptively controlling method of forgetting factor.
상세보기
Izhikevich, Eugene; Sinyavskiy, Oleg; Passot, Jean-Baptiste, Adaptive predictor apparatus and methods.
상세보기
Bourg, Jr., Wilfred Marcellien; Bruwer, Mark-John; MacGregor, John Fredrick; Miletic, Ivan P.; Pieterse, David John; Smith, Dale M., Advanced batch control.
상세보기
Prasad, Vijaysai; Radhakrishnan, Jayaprakash Sandhala; Zurlo, Jeffrey Allen; Hutte, Richard Stephen; Bhattacharyya, Arjun; Joshi, Manish, Advisory controls of desalter system.
상세보기
Brand, Matthew E., Analysis, synthesis and control of data signals with temporal textures using a linear dynamic system.
상세보기
Sinyavskiy, Oleg; Polonichko, Vadim, Apparatus and methods for backward propagation of errors in a spiking neuron network.
상세보기
Meier, Philip; Fisher, Dimitry; Roth, Chance; Hypnarowski, Steven, Apparatus and methods for computerized object identification.
상세보기
Piekniewski, Filip, Apparatus and methods for efficacy balancing in a spiking neuron network.
상세보기
Ponulak, Filip, Apparatus and methods for gating analog and spiking signals in artificial neural networks.
상세보기
Ponulak, Filip; Kazemi, Moslem; Laurent, Patryk; Sinyavskiy, Oleg; Izhikevich, Eugene, Apparatus and methods for haptic training of robots.
상세보기
Szatmary, Botond; Grotmol, Oyvind; Izhikevich, Eugene; Sinyavskiy, Oleg, Apparatus and methods for programming and training of robotic devices.
상세보기
Izhikevich, Eugene M., Apparatus and methods for pulse-code invariant object recognition.
상세보기
Grotmol, Oyvind; Sinyavskiy, Oleg, Apparatus and methods for training path navigation by robots.
상세보기
Ionescu, Dumitru Mihai, Apparatus, and associated method, for forming a systematic, recursive, space-time code.
상세보기
Meek, Christopher A.; Heckerman, David E.; Rounthwaite, Robert L.; Chickering, David Maxwell; Thiesson, Bo, Bayesian approach for learning regression decision graph models and regression models for time series analysis.
상세보기
Omar, Hanafy M., Control optimization method for helicopters carrying suspended loads.
상세보기
Nishi, Tomoki, Control policy learning and vehicle control method based on reinforcement learning without active exploration.
상세보기
Macharia, Maina A.; Tay, Michael E., Cook flash temperature optimization.
상세보기
Williams, Christopher Pierce, Data transfer application monitor and controller.
상세보기
Williams, Christopher Pierce, Data transfer application monitor and controller.
상세보기
Bocharov, Alexei V.; Chickering, David M.; Heckerman, David E., Detecting instabilities in time series forecasting.
상세보기
Piket,James B.; Owens,Keith L.; Springfield,Christopher W., Double talk activity detector and method for an echo canceler circuit.
상세보기
Piket,James B.; Iwai,Kyle K.; Rokusek,Daniel S., Downlink activity and double talk probability detector and method for an echo canceler circuit.
상세보기
Piket, James B.; Iwai, Kyle K.; Rokusek, Daniel S., Echo canceler circuit and method.
상세보기
Piket, James B.; Iwai, Kyle K.; Rokusek, Daniel S., Echo canceler circuit and method.
상세보기
Piket, James B.; Owens, Keith L.; Springfield, Christopher W., Echo canceler circuit and method.
상세보기
Piket, James B.; Owens, Keith L.; Springfield, Christopher W., Echo canceler circuit and method.
상세보기
Carrette, Pierre Christian Marie; Linn, Richard Eugene; Venkat, Aswin Nataraj, Economics-based coordination of advanced process control and real-time optimization.
상세보기
Thiesson, Bo; Meek, Christopher A., Efficient gradient computation for conditional Gaussian graphical models.
상세보기
Kramer, Robert A., Energy management system and methods for the optimization of distributed generation.
상세보기
Yasukawa, Kaoru; Adachi, Kouji; Uwatoko, Kouki; Yamada, Norikazu; Nakagawa, Eigo; Satonaga, Tetsuichi, Failure diagnosis method, failure diagnosis apparatus, conveyance device, image forming apparatus, program, and storage medium.
상세보기
Prokhorov, Danil V., Fixed-weight recurrent neural network controller with fixed long-term and adaptive short-term memory.
상세보기
Omar, Hanafy M., Fuzzy logic-based control method for helicopters carrying suspended loads.
상세보기
Thiesson,Bo; Meek,Christopher A., Gradient learning for probabilistic ARMA time-series models.
상세보기
Rokusek, Daniel; Sanjeev, Raghunandan; Kambhampati, Kranti, Hands-free circuit and method for communicating with a wireless device.
상세보기
Tohidi, Bahman; Yang, Jinhai; Chapoy, Antonin, Hydrate monitoring system.
상세보기
Piekniewski, Filip; Polonichko, Vadim; Izhikevich, Eugene, Increased dynamic range artificial neuron network apparatus and methods.
상세보기
Rietman, Edward A.; Card, Jill P., Large scale process control by driving factor identification.
상세보기
Watson, Jeff, Method and apparatus for artificially intelligent model-based control of dynamic processes using probabilistic agents.
상세보기
Zheng, Lei; Wu, Jian Kang, Method and apparatus for cancelling lighting variations in object recognition.
상세보기
Stork Genannt Wersborg, Ingo, Method and device for monitoring a laser processing operation to be performed on a workpiece and laser processing head having such a device.
상세보기
Lefebvre,Wesley Curt; Kohn,Daniel W., Method and system for SCR optimization.
상세보기
Rosenof,Howard; Lefebvre,W. Curt; Kohn,Daniel W.; Spinney,Peter, Method and system for calculating marginal cost curves using plant control models.
상세보기
Lefebvre,W. Curt; Kohn,Daniel W., Method and system for sootblowing optimization.
상세보기
Retsina,Theodora, Method and system for targeting and monitoring the energy performance of manufacturing facilities.
상세보기
Behmann, Matthias; Späth, Till; Wendelberger, Klaus, Method for controlling a combustion process, in particular in a firing chamber of a fossil-fuel-fired steam generator, and combustion system.
상세보기
Lefebvre,Wesley Curt; Kohn,Daniel W., Method for implementing indirect controller.
상세보기
Lefebvre,Wesley Curt; Kohn,Daniel W., Method for implementing indirect controller.
상세보기
Lefebvre,Wesley Curt; Kohn,Daniel W., Method for implementing indirect controller.
상세보기
Lefebvre, W. Curt; Kohn, Daniel W., Method for sootblowing optimization.
상세보기
Lefebvre, W. Curt; Kohn, Daniel W., Method for sootblowing optimization.
상세보기
Al-Duwaish, Hussain Nasser, Method of performing parallel search optimization.
상세보기
Brunell, Brent Jerome, Methods and apparatus for model predictive control of aircraft gas turbine engines.
상세보기
Palmer,John Davis; Uttamchandani,Sandeep Madhav; Voruganti,Kaladhar, Model and system for reasoning with N-step lookahead in policy-based system management.
상세보기
Swanson, Larry William; Beadie, Douglas Frank; Widmer, Neil Colin; Zhang, Hua; Kraemer, Gilbert Otto, Model based tempering air control and enhancement of exhaust for select catalytic reduction.
상세보기
Goldman,Arnold; Sarel,Shlomo; Hartman,Yehuda; Fisher,Yossi, Model predictive control (MPC) system using DOE based model.
상세보기
Macharia, Maina A.; Maxwell, Donald Melvin, Model predictive control of biofuel denaturant blending.
상세보기
Roettger, Thomas D.; Belkhayat, Mohamed; Nordby, Craig J.; Maurio, Joseph M.; Patalon, William, Motor controller with externally adjustable power rate constraints.
상세보기
Tsujino, Hiroshi; Miyakawa, Nobuaki; Matsumoto, Gen; Noyori, legal representative, Ryoji, Neural network element with reinforcement/attenuation learning.
상세보기
Nishi, Tomoki, Online learning and vehicle control method based on reinforcement learning without active exploration.
상세보기
Ibarz Gabardos, Borja; Sinyavskiy, Oleg, Persistent predictor apparatus and methods for task switching.
상세보기
Laurent, Patryk; Passot, Jean-Baptiste; Sinyavskiy, Oleg; Ponulak, Filip; Gabardos, Borja Ibarz; Izhikevich, Eugene, Predictive robotic controller apparatus and methods.
상세보기
Eglin, Paul, Process and device for determining in real time the behavior of a craft, in particular of an aircraft.
상세보기
Fisher, Dimitry; Izhikevich, Eugene M.; Buibas, Marius; Szatmary, Botond, Retinal apparatus and methods.
상세보기
Bezanson, Llewellyn W.; Ligon, Keith B.; Lakshman, Girish S., Selecting shipping methods dependent on a dynamic model of shipping activity.
상세보기
James, John Robert; McDermott, John; Piche, Stephen; Pickard, Fred; Parikh, Neel J., Sootblowing optimization for improved boiler performance.
상세보기
James, John Robert; McDermott, John; Piche, Stephen; Pickard, Fred; Parikh, Neel J., Sootblowing optimization for improved boiler performance.
상세보기
Hunt, Jonathan James; Sinyavskiy, Oleg, Spiking neuron classifier apparatus and methods using conditionally independent subsets.
상세보기
Lefebvre, W. Curt; Kohn, Daniel W., System and method for assigning credit to process inputs.
상세보기
Tournes, Christian; Shtessel, Yuri, System and method for guiding and controlling a missile using high order sliding mode control.
상세보기
Wintrich, Franz; Stephan, Volker; Schaffernicht, Erik; Steege, Florian, System for monitoring and optimizing controllers for process performance.
상세보기
Thiesson, Bo; Meek, Christopher A.; Chickering, David M.; Heckerman, David E., Systems and methods for new time series model probabilistic ARMA.
상세보기
Kim, Kilsoo; Yucelen, Tansel; Calise, Anthony J., Systems and methods for parameter dependent riccati equation approaches to adaptive control.
상세보기
Baramov, Lubomir, Target trajectory generator for predictive control of nonlinear systems using extended Kalman filter.
상세보기

IPC	Description
A	생활필수품
A62	인명구조; 소방(사다리 E06C)
A62B	인명구조용의 기구, 장치 또는 방법(특히 의료용에 사용되는 밸브 A61M 39/00; 특히 물에서 쓰이는 인명구조 장치 또는 방법 B63C 9/00; 잠수장비 B63C 11/00; 특히 항공기에 쓰는 것, 예. 낙하산, 투출좌석 B64D; 특히 광산에서 쓰이는 구조장치 E21F 11/00)
A62B-1/08	.. 윈치 또는 풀리에 제동기구가 있는 것

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 국가코드, 자료구분, 상태, 출원번호, 출원일자, 공개번호, 공개일자, 등록번호, 등록일자, 발명명칭(한글), 발명명칭(영문), 출원인(한글), 출원인(영문), 출원인코드, 대표IPC 관리번호, 국가코드, 자료구분, 상태, 출원번호, 출원일자, 공개번호, 공개일자, 공고번호, 공고일자, 등록번호, 등록일자, 발명명칭(한글), 발명명칭(영문), 출원인(한글), 출원인(영문), 출원인코드, 대표출원인, 출원인국적, 출원인주소, 발명자, 발명자E, 발명자코드, 발명자주소, 발명자 우편번호, 발명자국적, 대표IPC, IPC코드, 요약, 미국특허분류, 대리인주소, 대리인코드, 대리인(한글), 대리인(영문), 국제공개일자, 국제공개번호, 국제출원일자, 국제출원번호, 우선권, 우선권주장일, 우선권국가, 우선권출원번호, 원출원일자, 원출원번호, 지정국, Citing Patents, Cited Patents
저장형식	Text(ASCII format) Excel format PIAS분석(.xls)
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

Stable adaptive control using critic designs 원문보기

초록 ▼

대표청구항 ▼

연구과제 타임라인

이 특허를 인용한 특허 (78)

관련 콘텐츠

특허 원문 보기

IPC 상위 출원인

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트

연합인증

Stable adaptive control using critic designs 원문보기

초록 ▼

대표청구항 ▼

연구과제 타임라인

전체(0) 논문(0) 특허(0) 보고서(0)

전체(0) 논문(0) 특허(0) 보고서(0)

이 특허를 인용한 특허 (78)

관련 콘텐츠

특허 원문 보기

IPC 상위 출원인

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트