USPatentGranted
B2

Synchronous light pen electronic whiteboard system

Granted 8 Dec 2015 · 2 office actions

Assignee: NANJING FRENTEC CO., LTD.

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Wei Bao · Examiner: Larry Sternbane · AU 2699 · TC 2600

Life of the patent

8 dated events
⤢ drag to zoom20122014201620182020202220242026202820302032ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

The synchronous optical pen electronic whiteboard system in the present invention introduces an image sensor with a global shutter, optical pen pulsing light-emission and synchronizing signal transmitter and receiver. The light pulsing of the optical pen and the exposure of the image sensor coincide by synchronizing signal so as to realize the object of increasing signal-to-noise-ratio. A synchronizing signal sender can be arranged in the optical pen and a synchronizing signal receiver arranged in a signal receiving device, or a synchronizing signal sender can be arranged in the signal receiving device and a synchronizing signal receiver arranged in the optical pen. The coincidence of light pulsing and the exposure can be realized in the two solutions, thereby realizing the object of the present invention. By using the solution of the present invention, the power consumption of the optical pen can be reduced effectively and the signal to noise ratio of the system can be effectively increased in the meanwhile.

Description

5 parts
›TECHNICAL FIELD

The present invention relates to an electronic whiteboard system, specifically a synchronous optical pen electronic whiteboard system adopting optical imaging technology.

›TECHNICAL BACKGROUND

The electronic whiteboard system adopting optical imaging technology is realized through optical pen position tracking, see the China patent of the “System and Method for Computer Information Input Coordinate & Control” with the patent No. ZL011080477 and patent publication No. CN1305143A for detailed information. The operating principle: the target positions are marked by light spots generated by the optical pen, and a photographic device is adopted to collect images in real time. The signal processing circuit is used to analyze image signals in real time and extract the position information of the light spots, which is input into the computer through the interface circuit and the relative software. The coordinate correction algorithm is applied to perform calibration so that the position of the cursor can track the physical position of the optical pen. The current technology generally introduces an optical band-pass filter to ensure the best utilization of spectral energy and the best filtration of ambient light energy for the sake of high signal-noise-ratio (SNR) and operation stability, or increases the SNR by amplifying the light-emitting power. However there is a limit in the effect of using filters since light disturbance is still liable to occur under a certain luminance of the optical pen with possible strong ambient light and in addition, if the light-emitting power is increased too much, the power consumption will be high and the battery will be quickly drained. So a better method for further increasing the SNR should be developed.

›INVENTION DETAILS

The purpose of the present invention is to provide a synchronous optical pen electronic whiteboard system wherein the SNR can be improved without increasing the light-emitting power.

In order to reach the above target, a global shutter image sensor, as for the present invention, is installed on the signal receiving device of the synchronous optical pen electronic whiteboard system, the optical pen emits light by pulsing and the synchronizing signal sender and receiver are introduced, the pulsed light-emission of the optical pen and the exposure of the image sensor can happen synchronously through the synchronizing signals, thus SNR can be raised. There are two technical solutions: 1) A synchronous optical pen electronic whiteboard system, including the signal receiving device and optical pen, where the signal receiving device mainly comprises the receiving & processing circuit and a camera that is connected to the former, and the optical pen mainly comprises the head light emitting apparatus and optical pen circuit; wherein a synchronizing signal receiver in the signal receiving device is connected to the said receiving & processing circuit and the image sensor in the said camera allows global exposure, a corresponding synchronizing signal sender is installed in the said optical pen, the optical pen emits light by pulsing. 2) A synchronous optical pen electronic whiteboard system, including the signal receiving device and optical pen, where the signal receiving device mainly comprises the receiving & processing circuit and a camera that is connected to the former, and the optical pen mainly comprises the head light emitting apparatus and optical pen circuit; wherein the image sensor in the said camera allows global exposure, a synchronizing signal sender in the signal receiving device is connected to the said receiving & processing circuit, and a corresponding synchronizing signal receiver is installed in the said optical pen that emits light by pulsing.

As for both solutions, the synchronizing signals allow the coincidence of the exposure of the image sensor and the light pulsing of the optical pen. So suppose the exposure time of each pixel, the image collection period and the effective intensity of the ambient light are T_shut, T and Ie respectively, the SNR of the system, as for the present invention, will be (T_shut*Ip)/(T_shut*Ie)=Ip/Ie, the average power consumption of the optical pen will be a*Ip*T_shut, where a refers to a constant coefficient and Ip refers to the average light intensity within the pulse time of the optical pen. However, as for current technology, suppose the continuous light intensity is Is, the SNR will be indicated as (T_shut*Is)/(T_shut*Ie)=Is/Ie, the average power consumption of the optical pen will be a*Is*T. According to the above formula, if Ip=Is, T_shut=T/4, the SNRs as for the present invention and current technology are the same, however the power consumption of the optical pen decreases by 75% compared with that of current technology, i.e. when the SNR is kept, the power consumption of the optical pen for the system of the present invention decreases greatly, prolonging the power supply time. If the light-emitting power doubles during the optical pen pulsed light-emission, i.e. Ip=Is*2 and also T_shut=T/4, the SNR for the system of the present invention can also be doubled while the average power consumption of the optical pen can decrease by 50%, i.e. the SNR can be increased when the power consumption of the pen is decreased if the relevant parameters are set properly. If the circuit gain is increased and further shortening of exposure time is made, the SNR can be increased or the average power consumption of the optical pen can be decreased.

When the solutions of the present invention are adopted, the power consumption of the optical pen can be decreased, the power supply time prolonged and the SNR of the system increased effectively, improving the product's properties greatly, so the practical value of the present invention can be known.

›ATTACHED FIGURES

FIG. 1 shows the structural representation for the optical pen of the synchronous optical pen electronic whiteboard system of the first embodiment of the present invention.

FIG. 2 shows the structural representation for the signal receiving device of the first embodiment of the present invention.

FIG. 3 shows the structural representation for the optical pen of the synchronous optical pen electronic whiteboard system of the second embodiment of the present invention.

FIG. 4 shows the structural representation for the signal receiving device of the second embodiment of the present invention.

Where: head light emitting apparatus 1 , optical pen circuit 2 , case 3 , synchronizing signal receiver 4 , camera 5 , receiving & processing circuit 6 , synchronizing signal sender 7 .

›DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Further description about the present invention is made based on the following attached figures and examples.

Both FIGS. 1 and 2 show the embodiment of the structural representation for the synchronous optical pen electronic whiteboard system of the present invention. The head light emitting apparatus ( 1 ) is an IR emitting tube that is set on the pen head and connected to the optical pen circuit ( 2 ) in the case ( 3 ), which is a common arrangement for current technologies. The optical pen circuit ( 2 ) is a circuit that is formed by an MCU core. Under the control of the MCU, when the optical pen emits light, the light-emitting pulse width and period are approx. 5 ms and 20 ms respectively, where each pulse is modulated at the carrier of 38 KHz. The synchronizing signal receiver ( 4 ) is a common 38 KHz IR receiving module used for IR remote control, which is connected to the receiving & processing circuit ( 6 ). When the light-emitting pulse of a optical pen reaches the said IR receiving module, it will perform signal output under the carrier of 38 KHz. The camera ( 5 ) comprises a CMOS image sensor MT9V034 featuring global shutter, a lens and a filter etc., where the image sensor MT9V034 is operated under the Slave mode, and under the control of the receiving & processing circuit ( 6 ), the exposure is only allowed when carrier signals are received, thus the light-emission of the optical pen and the exposure of the camera can be performed synchronously.

In this embodiment, the exposure period and light-emitting pulse width are 20 ms and 5 ms respectively. The light intensity within the pulse is twice that of current optical pens, so the average power consumption is about ½ that of current optical pens. The SNR of the system is doubled i.e. when the power consumption of the optical pen is decreased by 50%, the SNR of the system is increased by 100%, improving the properties of the system greatly. As for the above embodiment, the IR carrier emission is performed by the light-emitting apparatus of the pen head that is also a synchronizing signal sender, simplifying the use of hardware and realizing efficient operation. However, if the pen head emits non-IR light, an independent IR emitting tube is needed and used as the synchronizing signal sender. The synchronizing signals can also be sent or received by RF sending modules and RF receiving modules.

As for the second embodiment of the present invention, the synchronous signals are sent by the synchronizing signal sender ( 7 ) of the signal receiver, while for the optical pen, a relevant synchronizing signal receiver ( 4 ) is provided, which can also allow synchronization between the light-emission of the optical pen and exposure of the camera, reaching the goal of the present invention. The advantage of this solution is that several pens can be used at the same time based on an appropriate instructional design since the synchronous signals can be received by several pens, see FIGS. 3 and 4 .

Though preferred embodiments in relation to the present invention are shown as above, the present invention is not limited to these embodiments and attached figures. Changes or modification of the operation conducted by skilled operators should be subject to the principles, range and protection domain of the present invention and therefore the protection domain of the present invention should be kept within the scope of the claims.

Claims

8 · 2 independent · depth 3
12345678
8 granted claims

Classifications

3 codes
IPC · International Patent Classification
Section G — Physics
  • G06F3/0354
  • G06F3/038
  • G06F3/042

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this patent are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJan 2012Jul 2012Jan 2013Jul 2013Jan 2014Jul 2014Jan 2015Jul 2015Jan 2016USPTOApplicantNon-final rejectionNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
3.8 y
1,397 days filing → grant
Office actions
1
non-final + final
Responses
1
no RCE
Examiner
Larry Sternbane
art unit 2699 · TC 2600
Citations: 5 back · 0 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Chain of title

⤢ drag to zoom201620182020202220242026202820302032Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock

Term & fees

See the term timeline — pendency span, in-force span, the maintenance fees paid and both computed expiry dates.

Log in to unlock

Priority chain

1 priority documents
›Priority documents — 1
TypeDocumentDate
related publicationUS 20130307830 A121 Nov 2013

Worldwide family

10 members · 6 offices
US2EP2JP1KR2CN2WO1
this patentIP5 & PCTother officessolid = grantedhover for detail · click to open
Members
10
DOCDB simple family 44295644
Offices
6
US · EP · JP · KR · CN · WO
Granted
3 of 10
grant date present
Non-English titles
5
shown as filed, never translated
›IP5 & PCT — 10 members
OfficePublicationKindPublishedFiledStatusTitle
USUS-2013307830-A1A121 Nov 201310 Feb 2012publishedSynchronous light pen electronic whiteboard system
USthis patentUS-9207783-B2B28 Dec 201510 Feb 2012grantedSynchronous light pen electronic whiteboard system
EPEP-2696267-A1A112 Feb 201410 Feb 2012publishedElektronisches weisstafelsystem mit synchronen lichtstiftende
EPEP-2696267-A4A45 Nov 201410 Feb 2012publishedSynchronous light pen electronic whiteboard system
JPJP-2014505300-AA27 Feb 201410 Feb 2012published同期式光学ペン型電子ホワイトボードシステムja
KRKR-20130115335-AA21 Oct 201310 Feb 2012publishedSynchronous light pen electronic whiteboard system
KRKR-101565451-B1B14 Nov 201510 Feb 2012granted동기식 레이저 포인트 전자 화이트 보드 시스템ko
CNCN-102135842-AA27 Jul 20116 Apr 2011publishedSynchronous light pen electronic whiteboard system
CNCN-102135842-BB27 Feb 20136 Apr 2011granted同步光笔电子白板系统zh
WOWO-2012136084-A1A111 Oct 201210 Feb 2012published同步光笔电子白板系统zh

Validity challenges

See the validity challenges on record — reexaminations, IPRs and PGRs, with their institution decisions and outcomes.

Log in to unlock

Citations

See every patent this one cites and every patent that cites it back — publication, assignee, and how each one was found.

Log in to unlock