Systems, devices, and methods for on-board sensing and control of micro aerial vehicles
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G05D-001/00
G05D-001/08
G08G-005/00
B64C-039/02
G01C-021/16
G01C-021/20
출원번호
US-0218938
(2016-07-25)
등록번호
US-10037028
(2018-07-31)
발명자
/ 주소
Loianno, Giuseppe
Mulgaonkar, Yash Shailesh
Kumar, R. Vijay
출원인 / 주소
The Trustees of the University of Pennsylvania
대리인 / 주소
Jenkins, Wilson, Taylor & Hunt, P.A.
인용정보
피인용 횟수 :
0인용 특허 :
16
초록▼
Systems, devices, and methods for on-board sensing and control of robotic vehicles (e.g., MAVs) using commercial off-the-shelf hand-held electronic devices as a sensing and control system are provided. In one aspect, a system for controlling a micro aerial vehicle may include one or more sensors, a
Systems, devices, and methods for on-board sensing and control of robotic vehicles (e.g., MAVs) using commercial off-the-shelf hand-held electronic devices as a sensing and control system are provided. In one aspect, a system for controlling a micro aerial vehicle may include one or more sensors, a state estimation module in communication with the one or more sensors, the state estimation module being configured to generate an estimated pose of the micro aerial vehicle based on inputs from the one or more sensors, and a position controller in communication with the state estimation module and configured to communicate attitude commands to an attitude controller of the micro aerial vehicle. Each of the one or more sensors, the state estimation module, and the position controller may be contained in a commercial off-the-shelf hand-held electronic device that is configured to be coupled to the micro aerial vehicle.
대표청구항▼
1. A system for controlling a micro aerial vehicle comprising: one or more sensors, wherein the one or more sensors comprise one or more cameras and one or more of a gyroscope and/or an accelerometer;a state estimation module in communication with the one or more sensors, the state estimation module
1. A system for controlling a micro aerial vehicle comprising: one or more sensors, wherein the one or more sensors comprise one or more cameras and one or more of a gyroscope and/or an accelerometer;a state estimation module in communication with the one or more sensors, the state estimation module comprising: a visual inertial odometry system in communication with the one or more cameras and the one or more of a gyroscope and/or an accelerometer; andan estimator in communication with the visual inertial odometry system and the one or more sensors, the estimator being configured to generate a state estimate of the micro aerial vehicle based on inputs from the one or more of a gyroscope and/or an accelerometer and to generate an estimated pose by updating the state estimate based on inputs from the visual inertial odometry system; anda position controller in communication with the state estimation module and configured to communicate attitude commands to an attitude controller of the micro aerial vehicle;wherein the state estimation module is configured to transmit the estimated pose to the position controller at a rate of about 200 Hz or greater; andwherein each of the one or more sensors, the state estimation module, and the position controller are contained in a hand-held electronic device that is mounted to the micro aerial vehicle. 2. The system of claim 1, wherein the estimator comprises an Unscented Kalman Filter in communication with the one or more sensors. 3. The system of claim 1, wherein the state estimation module is configured to send visualization data of the estimated pose to a remote user interface. 4. The system of claim 1, wherein the position controller comprises a nonlinear controller. 5. The system of claim 1, wherein the position controller is configured to receive trajectory planning information from a remote user interface. 6. The system of claim 1, wherein the attitude controller is contained in the hand-held electronic device. 7. A method for controlling a micro aerial vehicle using a hand-held electronic device, the method comprising: mounting the hand-held electronic device to the micro aerial vehicle;receiving inputs from one or more sensors in the hand-held electronic device, wherein the one or more sensors comprise one or more cameras and one or more of a gyroscope and/or an accelerometer;generating an estimated pose of the micro aerial vehicle based on the inputs from the one or more sensors, wherein generating the estimated pose comprises: generating a state estimate of the micro aerial vehicle based on inputs from the one or more of a gyroscope and/or an accelerometer; andusing visual inertial odometry to localize dynamics of a body of the micro aerial vehicle with respect to an inertial frame and update the state estimate based on inputs from the one or more cameras;generating attitude commands based on the estimated pose of the micro aerial vehicle; andcommunicating the attitude commands to a control component of the micro aerial vehicle;wherein generating an estimated pose of the micro aerial vehicle comprises updating the state estimate at a rate of about 200 Hz or greater;wherein receiving inputs, generating an estimated pose, and generating attitude commands are all performed on the hand-held electronic device. 8. The method of claim 7, wherein generating an estimated pose comprises applying an Unscented Kalman Filter to the inputs from one or more sensors to estimate a full state of the micro aerial vehicle. 9. The method of claim 7, wherein generating attitude commands further comprises receiving trajectory planning information from a remote user interface. 10. The method of claim 7, wherein generating attitude commands further comprises coordinating a trajectory plan with at least one additional micro aerial vehicle. 11. The method of claim 10, wherein coordinating a trajectory plan comprises: at a remote user interface, determining a solution for a system of equations that represent straight-line trajectories of each of the micro aerial vehicle and the at least one additional micro aerial vehicle;sending coefficients of a respective one of the system of equations to the micro aerial vehicle; andgenerating the attitude commands based on the coefficients. 12. The method of claim 7, wherein the control component is contained in the hand-held electronic device. 13. The method of claim 7, further comprising sending visualization data of the estimated pose to a remote user interface. 14. The method of claim 13, wherein the visualization data of the estimated pose comprises point clouds.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (16)
Ma, Yunqian; Hawkinson, Wesley J., Camera and inertial measurement unit integration with navigation data feedback for feature tracking.
van der Merwe,Rudolph; Wan,Eric A.; Julier,Simon J., Navigation system applications of sigma-point Kalman filters for nonlinear estimation and sensor fusion.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.