ToF AR v1.5.0

Changes in ToF AR v1.5.0

  • New features and feature enhancements
    Body component
  • Enabled body gesture recognition with SV2 mode and added 11 new gestures.
  • Added a setting to reduce the number of recognition process calls when no person is present in the camera footage.
  • Fixed an issue where body recognition results could not be obtained when using ARFoundationConnector.
  • Fixed an issue where Depth View would not rotate immediately after playback in the Unity Editor. [ToF AR Pro]
  • Fixed an issue where bone display was misaligned. [ToF AR Pro]
  • Fixed an issue where a bone connected to an unrecognized joint was stretched and displayed. [ToF AR Pro]
  • Added a process to hide the skeleton when the Stream is set to OFF. [ToF AR Pro]
  • Improved the accuracy of body estimation. [ToF AR Pro]
  • Added an adjustment feature for the displayed skeleton size. [ToF AR Pro]
  • Color component
  • Added methods "TofArColorManager.CurrentYUVFrameInfo" and "TofArColorManager.DecodeYUVData()" to obtain the necessary information for decoding YUV format frames.
  • Enabled display in Linear color space in the Color image display class.
  • Added a field "ColorData.ProcessTimeNs" to get internal process time.
  • Face component
  • Added a field "FaceData.ProcessTimeNs" to get internal process time.
  • Fixed an issue where calling TofArFaceManager.StartStream() did not start the stream but triggered the StreamStarted event when the ToF AR Server was not connected.
  • Hand component
  • Improved the accuracy of hand recognition.
  • Fixed an issue where Depth View would not rotate immediately after playback in the Unity Editor. [ToF AR Pro]
  • Fixed an issue where bone display was misaligned. [ToF AR Pro]
  • Fixed an issue where a bone connected to an unrecognized joint was stretched and displayed. [ToF AR Pro]
  • Added an adjustment feature for the displayed skeleton size. [ToF AR Pro]
  • Added a process to hide the skeleton when the Stream is set to OFF. [ToF AR Pro]
  • Added a feature to display the Upper Body of the Hand component in SkeletonDepthView. [ToF AR Pro]
  • Humanoid component
  • Fixed a bug where an exception occurred when the Face recognition result was null in the FaceSkeleton2D class. [ToF AR Pro]
  • SLAM component
  • Fixed an issue where the stream could not be started when TofArSlamManager.trackerObject was in an uninitialized state.
  • ToF Component
  • Added ProcessTimeNs to DepthData, ConfidenceData, and PointCloudData to obtain internal process time.
  • Fixed an issue that could cause a crash during TofArTofManager initialization on Xperia model devices.
  • Others
  • Updated recommended software versions for development.
    • Unity
      • Unity 2021.3.31f1 → Unity 2022.3.54f1
      • Unity 2022.3.11f1 → Unity 6000.0.30f1
    • AR Foundation
      • V4.2.8 → V5.1.5
    • ARCore Extensions
      • V1.40.0 → V1.46.0
  • Added compatible devices (iPhone 16, iPad 11-inch 5th, iPad 13-inch 7th)
  • Replaced the use of Unity's standard functions FindObjectOfType and FindObjectsOfType with FindAnyObjectByType and FindObjectsByType.
  • Adjusted the display order of the Noise Reduction Level list.
  • Changed the camera selection display toggle parameter in the common UI from a private to a public variable.
  • Removed features that were marked with the Obsolete attribute.
  • Fixed an issue where TofArManager's inspector settings were not applied when connecting to the ToF AR Server.
  • Fixed an issue where Depth data values beyond 8192mm were not correctly obtained when using ARFoundationConnector.
  • Fixed an issue where the External option was not displayed in the ToF resolution list on Xperia model devices.
  • Changed the specification to wait for the mode change to complete when another change process is executed while changing the mode using the Controller.
  • Fixed an issue with retrieving the supported Color resolution list on Mate 40 Pro.
  • Fixed an issue where the correct device rotation information was sometimes not obtained when connecting to the ToF AR Server.
  • Fixed an issue where the default resolution was not as expected when using the front camera with AVFoundation on unsupported ToF AR iOS devices.
  • Supported simultaneous streaming of ToF and Color cameras with different camera IDs when using AVFoundation on iOS devices.
  • Fixed an issue where a crash occurred when starting ToF or Color recording using AVFoundation on iOS devices.
  • Added support for ORBBEC and Azure Kinect on the Windows version. [ToF AR Pro]
  • Fixed an issue where NullReferenceException and MissingReferenceException occurred at the end of playback in the Unity Editor. [ToF AR Pro]
  • Added a process to apply skeleton display ON/OFF from the Inspector while running ToF AR Server + Editor. [ToF AR Pro]
  • Fixed other bugs.
  • 機能追加、機能改善
    Bodyコンポーネント
  • SV2モードでボディジェスチャ認識を動作するように対応し、11種類の新しいジェスチャを追加
  • 人物がカメラ映像に存在しない場合に認識処理を呼び出す回数を減らす設定を追加
  • ARFoundationConnector で Body 認識結果が取得できなくなっていた問題を修正
  • Unity Editor上で再生直後、Depth View が回転しない問題を修正【 ToF AR Pro 】
  • bone の表示がずれる問題を修正【 ToF AR Pro 】
  • 未認識の関節に繋がる bone が伸びて表示される問題を修正【 ToF AR Pro 】
  • Stream を OFF にした時、骨格を非表示にする処理を追加【 ToF AR Pro 】
  • 全身推定の精度を改善【 ToF AR Pro 】
  • 表示される骨格表示のサイズ調整機能の追加【 ToF AR Pro 】
  • Colorコンポーネント
  • TofArColorManager に YUV フォーマットのフレームをデコードするために必要な情報を取得できるメソッド TofArColorManager.CurrentYUVFrameInfo, TofArColorManager. DecodeYUVData() を追加
  • Color 映像表示クラスで Linear カラースペースでの表示を可能にした
  • 内部処理時間を取得できるフィールド ColorData.ProcessTimeNs を追加
  • Faceコンポーネント
  • 内部処理時間を取得できるフィールド FaceData.ProcessTimeNs を追加
  • ToF AR Server 未接続時に TofArFaceManager.StartStream() を呼び出すと Stream は開始しないが、StreamStarted イベントが発生する問題を修正
  • Handコンポーネント
  • 手認識の精度を改善
  • Unity Editor上で再生直後、Depth View が回転しない問題を修正【 ToF AR Pro 】
  • bone の表示がずれる問題を修正【 ToF AR Pro 】
  • 未認識の関節に繋がる bone が伸びて表示される問題を修正【 ToF AR Pro 】
  • 表示される骨格表示のサイズ調整【 ToF AR Pro 】
  • Stream を OFF にした時、骨格を非表示にする処理を追加【 ToF AR Pro 】
  • SkeletonDepthView に Hand コンポーネントの UpperBody を表示する機能を追加【 ToF AR Pro 】
  • Humanoidコンポーネント
  • FaceSkeleton2D クラスで Face 認識結果が null の場合、例外が発生していた不具合を修正【 ToF AR Pro 】
  • SLAMコンポーネント
  • TofArSlamManager.trackerObject を未設定状態とするとストリームを開始できない問題を修正
  • ToFコンポーネント
  • 内部処理時間を取得できるフィールド DepthData, ConfidenceData, PointCloudData の ProcessTimeNs を追加
  • Xperia 系端末で TofArTofManager 初期化時にクラッシュが発生することがある問題を修正
  • その他
  • 開発に必要なソフトウェアの推奨バージョンを更新
    • Unity
      • Unity 2021.3.31f1 → Unity 2022.3.54f1
      • Unity 2022.3.11f1 → Unity 6000.0.30f1
    • AR Foundation
      • V4.2.8 → V5.1.5
    • ARCore Extensions
      • V1.40.0 → V1.46.0
  • 対応端末の追加 （ iPhone 16、iPad 11-inch 5th、iPad 13-inch 7th）
  • Unity 標準関数 FindObjectOfType, FindObjectsOfType を使用している箇所を FindAnyObjectByType, FindObjectsByType に置き換え
  • Noise Reduction Level 選択リストの表示順を調整
  • 共通 UI のカメラ選択項目の表示切替パラメーターを private から public の変数に変更
  • Obsolete 属性が付与されていた機能を削除
  • TofArManager のインスペクタ上の設定が ToF AR Server に接続した際に反映されない問題を修正
  • ARFoundationConnector 使用時に 8192mm 以遠の Depth データ値が正しく取得できない問題を修正
  • Xperia 1 シリーズで ToF 解像度リストに External 項目が表示されなくなっていた問題を修正
  • RecogModeController を使用して Mode を変更中に再度変更処理が実行された場合、変更完了まで処理を待機する仕様に変更
  • Mate 40 Pro での対応 Color 解像度リスト取得処理の不具合修正
  • ToF AR Server 接続時に正しい端末回転方向情報が取得できないことがある問題を修正
  • ToF AR 未サポート iOS デバイスにおいて、AVFoundation でフロントカメラを使用する際のデフォルト解像度が期待しないものとなる現象を修正
  • iOS で AVFoundation を使用する際、カメラ ID の異なる ToF カメラと Color カメラの同時ストリームに対応
  • iOS で AVFoundation を使用する際、ToF や Color の Recording を開始する時にクラッシュが発生していた問題を修正
  • Windows 版において ORBBEC、Azure Kinect に対応【 ToF AR Pro 】
  • Unity Editor上で再生終了時に NullReferenceException, MissingReferenceException が出る問題を修正【 ToF AR Pro 】
  • Server + Editor 実行中に Inspector から骨格表示の ON / OFF を適用する処理を追加【 ToF AR Pro 】
  • その他不具合修正

MAY 19, 2025 | 904 MB

TOFAR_PRO_TRIAL_V1.5.0.ZIP

Download

Terms & Conditions of ToF (Time of Flight) AR Pro

Terms & Conditions of ToF (Time of Flight) AR Pro

Effective Date: 2025/05/19

This Terms & Conditions (“T&Cs” or “Agreement”) is a legal agreement between you and Sony Music Solutions Inc.("SONY"). This T&Cs governs your rights and obligations regarding the ToF(Time of Flight) AR Pro software, which is owned or controlled by SONY Semiconductor Solutions Corporation (“OWNER”) and/or its third party licensors (including OWNER's affiliates) and their respective affiliates (collectively, the "THIRD-PARTY SUPPLIERS"), together with any updates/upgrades provided by OWNER, any printed, on-line or other electronic documentation for such software, and any data files created by operation of such software (collectively, the "SOFTWARE"). Notwithstanding the foregoing, any software in the SOFTWARE having a separate end user license agreement (including, but not limited to, GNU General Public license and Lesser/Library General Public License) shall be covered by such applicable separate end user license agreement in lieu of the terms of this T&Cs to the extent required by such separate end user license agreement ("EXCLUDED SOFTWARE"). For the purpose of this T&Cs, you agree that SONY and OWNER may share with each other any and all your information regarding this T&Cs, including, but not limited to, Feedback (Section 1.4), SONY and OWNER may be free to use such information without limitation.

1. GRANT OF LICENSE

1.1 SONY grants you a limited, non-exclusive, non-transferable, non-sublicensable license to use and reproduce the SOFTWARE and incorporate the SOFTWARE into the Application defined below, solely for the purpose of evaluation of the SOFTWARE to develop application software that includes depth sensing technology (such application software you have developed shall hereinafter be referred to as the “Application” and such purpose shall hereinafter be referred to as the “Purpose”).

1.2 You may use contractors to assist you to effectuate the purposes set forth Section 1.1 above, provided that you will remain fully liable for its compliance with this Agreement and for its contractors’ compliance with this Agreement.

1.3 The SOFTWARE is licensed, not sold. The SOFTWARE is protected by copyright and other intellectual property laws and international treaties. All right and title in and to the SOFTWARE is owned by OWNER or one or more of the THIRD-PARTY SUPPLIERS, and OWNER and the THIRD-PARTY SUPPLIERS expressly reserve all rights, title and interest (including, but not limited to, all intellectual property rights) in and to the SOFTWARE that this T&Cs does not specifically grant to you.

1.4 SONY and OWNER may, from time to time, collect and/or request you to provide the information or data regarding your usage situation or status of the SOFTWARE (“Feedback”), and SONY and OWNER may be free to use the Feedback without limitation. You shall reasonably cooperate with SONY and OWNER and answer to such request.

1.5 At this time, SONY grants you a license under Section 1.1 for the Purpose free of charge. SONY reserves the right to charge fees for use of any portion of the SOFTWARE now or in the future at any time in its sole discretion.

2. REQUIREMENTS AND LIMITATIONS

2.1 Except as otherwise set forth in this T&Cs, you may not

  1. copy, publish, adapt, redistribute, attempt to derive source code, modify, reverse engineer, decompile, or disassemble any of the SOFTWARE, whether in whole or in part, or create any derivative works from or of the SOFTWARE unless such derivative works are intentionally facilitated by the SOFTWARE.
  2. modify or tamper with any digital rights management functionality of the SOFTWARE.
  3. bypass, modify, defeat or circumvent any of the functions or protections of the SOFTWARE or any mechanisms operatively linked to the SOFTWARE.
  4. remove, alter, cover or deface any trademarks or notices on the SOFTWARE
  5. share, distribute, rent, lease, loan, timeshare, sublicense, assign, transfer or sell the SOFTWARE including Application into which SOFTWARE is incorporated.
  6. use the SOFTWARE including Application into which SOFTWARE is incorporated in connection with violation of laws, regulations, court decisions or other legally binding dispositions by a public authority or public policy, or infringement of the rights or legally protected interests (including, but not limited to, intellectual and other property rights, rights to trade secrets, honors, privacy and publicity) of OWNER, each of the THIRD-PARTY SUPPLIERS or any third parties.
  7. use or allow using the SOFTWARE including Application into which SOFTWARE is incorporated for any end use for military, police, public safety commission or intelligence agency.

3. USER ELIGIBILITY

3.1 The SOFTWARE is exclusively for business entities and educational institutions. By accepting this Agreement, you represent and warrant that you are a business entity or an educational institution.

3.2 You represent and warrants that the individual who accepts this Agreement on behalf of you (i) is duly authorized to enter into this Agreement, (ii) has the authority to bind you to the terms and conditions set forth in this Agreement, and (iii) has read, understood, and agreed to be bound by all of the terms and conditions of this Agreement.

4. EXCLUDED SOFTWARE AND OPEN SOURCE COMPONENTS

Notwithstanding the foregoing limited license grant, you acknowledge that the SOFTWARE may include EXCLUDED SOFTWARE. Certain EXCLUDED SOFTWARE may be covered by open source software licenses ("Open Source Components"), which means any software licenses approved as open source licenses by the Open Source Initiative or any substantially similar licenses, including but not limited to any license that, as a condition of distribution of the software licensed under such license, requires that the distributor make the software available in source code format. If and to the extent disclosure is required, you must visit www.sony.net/Products/Linux or other SONY-designated web site for a list of applicable OPEN SOURCE COMPONENTS included in the SOFTWARE from time to time, and the applicable terms and conditions governing its use. Such terms and conditions may be changed by the applicable third party at any time without liability to you. To the extent required by the licenses covering EXCLUDED SOFTWARE, the terms of such licenses will apply in lieu of the terms of this T&Cs. To the extent the terms of the licenses applicable to EXCLUDED SOFTWARE prohibit any of the restrictions in this T&Cs with respect to such EXCLUDED SOFTWARE, such restrictions will not apply to such EXCLUDED SOFTWARE. To the extent the terms of the licenses applicable to Open Source Components require OWNER to make an offer to provide source code in connection with the SOFTWARE, such offer is hereby made.

5. EXPORT AND OTHER REGULATIONS

You agree to comply with all applicable export and re-export restrictions and regulations of the area or country in which you reside, and not to transfer, or authorize the transfer, of the SOFTWARE to a prohibited country or otherwise in violation of any such restrictions or regulations.

6. HIGH RISK ACTIVITIES

The SOFTWARE is not fault-tolerant and is not designed, manufactured or intended for use or resale as on-line control equipment in hazardous environments requiring fail-safe performance, such as in the operation of nuclear facilities, aircraft navigation or communication systems, air traffic control, direct life support machines, or weapons systems, in which the failure of the SOFTWARE could lead to death, personal injury, or severe physical or environmental damage ("HIGH RISK ACTIVITIES"). SONY, OWNER, each of the THIRD-PARTY SUPPLIERS, and each of their respective affiliates specifically disclaim any express or implied warranty, duty or condition of fitness for HIGH RISK ACTIVITIES.

7. EXCLUSION OF WARRANTY ON SOFTWARE

7.1 You acknowledge and agree that use of the SOFTWARE and any derivatives thereof including but not limited to hand gesture images which may be created by the SOFTWARE (for purposes of this Section, the SOFTWARE and such derivatives shall be collectively referred to as the “SOFTWARE”) is at your sole risk and that you are responsible for use of the SOFTWARE. The SOFTWARE is provided "AS IS," without warranty, duty or condition of any kind. SONY, OWNER AND EACH OF THE THIRD-PARTY SUPPLIERS (for purposes of this Section, SONY, OWNER and each of the THIRD-PARTY SUPPLIERS shall be collectively referred to as "SONY") EXPRESSLY DISCLAIM ALL WARRANTIES, DUTIES OR CONDITIONS, EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, NONINFRINGEMENT AND FITNESS FOR A PARTICULAR PURPOSE. SONY DOES NOT WARRANT OR MAKE ANY CONDITIONS OR REPRESENTATIONS (A) THAT THE FUNCTIONS CONTAINED IN ANY OF THE SOFTWARE WILL MEET YOUR REQUIREMENTS OR THAT THEY WILL BE UPDATED, (B) THAT THE OPERATION OF ANY OF THE SOFTWARE WILL BE CORRECT OR ERROR-FREE OR THAT ANY DEFECTS WILL BE CORRECTED, (C) THAT THE SOFTWARE WILL NOT DAMAGE ANY OTHER SOFTWARE, HARDWARE OR DATA, (D) THAT ANY SOFTWARE, NETWORK SERVICES (INCLUDING THE INTERNET) OR PRODUCTS (OTHER THAN THE SOFTWARE) UPON WHICH THE SOFTWARE'S PERFORMANCE DEPENDS WILL CONTINUE TO BE AVAILABLE, UNINTERRUPTED OR UNMODIFIED, AND (E) REGARDING THE USE OR THE RESULTS OF THE USE OF THE SOFTWARE IN TERMS OF ITS CORRECTNESS, ACCURACY, RELIABILITY, OR OTHERWISE. NO ORAL OR WRITTEN INFORMATION OR ADVICE GIVEN BY SONY OR AN AUTHORIZED REPRESENTATIVE OF SONY SHALL CREATE A WARRANTY, DUTY OR CONDITION OR IN ANY WAY INCREASE THE SCOPE OF THIS WARRANTY. SHOULD THE SOFTWARE PROVE DEFECTIVE YOU ASSUME THE ENTIRE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OF IMPLIED WARRANTIES, SO THESE EXCLUSIONS MAY NOT APPLY TO YOU.

7.2 The software might be modified, interrupted or discontinued at the discretion of the suppliers (software suppliers, service suppliers, or OWNER ). OWNER, SONY and such suppliers do not warrant that the SOFTWARE, network services, contents or other products will continue to be available, or will operate without interruption or modification.

8. LIMITATION OF LIABILITY

SONY, OWNER AND EACH OF THE THIRD-PARTY SUPPLIERS (for purposes of this Section, SONY and each of the THIRD-PARTY SUPPLIERS shall be collectively referred to as "SONY") SHALL NOT BE LIABLE FOR ANY INCIDENTAL OR CONSEQUENTIAL DAMAGES FOR BREACH OF ANY EXPRESS OR IMPLIED WARRANTY, BREACH OF CONTRACT, NEGLIGENCE, STRICT LIABILITY OR UNDER ANY OTHER LEGAL THEORY RELATED TO THE SOFTWARE, INCLUDING, BUT NOT LIMITED TO, ANY DAMAGES ARISING OUT OF LOSS OF PROFITS, LOSS OF REVENUE, LOSS OF DATA, LOSS OF USE OF THE SOFTWARE OR ANY ASSOCIATED HARDWARE, DOWN TIME AND USER'S TIME, EVEN IF ANY OF THEM HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN ANY CASE, EACH AND ALL OF THEIR AGGREGATE LIABILITY UNDER ANY PROVISION OF THIS T&Cs SHALL BE LIMITED TO THE AMOUNT ACTUALLY PAID FOR THE PRODUCT. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OR LIMITATION OF INCIDENTAL OR CONSEQUENTIAL DAMAGES, SO THE ABOVE EXCLUSION OR LIMITATION MAY NOT APPLY TO YOU.

9. ENTIRE AGREEMENT, WAIVER, SEVERABILITY

This T&Cs as amended and modified from time to time, together constitute the entire agreement between you and SONY with respect to the SOFTWARE. The failure of SONY and/or OWNER to exercise or enforce any right or provision of this T&Cs shall not constitute a waiver of such right or provision. If any part of this T&Cs is held invalid, illegal, or unenforceable, that provision shall be enforced to the maximum extent permissible so as to maintain the intent of this T&Cs, and the other parts will remain in full force and effect.

10. GOVERNING LAW AND JURISDICTION

The United Nations Convention on Contracts for the International Sale of Goods shall not apply to this T&Cs. This T&Cs shall be governed by the laws of Japan, without regards to conflict of laws provisions. Any dispute arising out of this T&Cs shall be subject to the exclusive venue of the Tokyo District Court in Japan, and the parties hereby consent to the venue and jurisdiction of such courts.

11. EQUITABLE REMEDIES

Notwithstanding anything contained in this T&Cs to the contrary, you acknowledge and agree that any violation of or non-compliance with this T&Cs by you will cause irreparable harm to SONY and/or OWNER, for which monetary damages would be inadequate, and you consent to SONY and/or OWNER obtaining any injunctive or equitable relief that SONY and/or OWNER deems necessary or appropriate in such circumstances. SONY and/or OWNER may also take any legal and technical remedies to prevent violation of and/or to enforce this T&Cs, including, but not limited to, immediate termination of your use of the SOFTWARE, if SONY and/or OWNER believes in its sole discretion that you are violating or intend to violate this T&Cs. These remedies are in addition to any other remedies SONY and/or OWNER may have at law, in equity or under contract.

12. TERM AND TERMINATION

12.1 This T&Cs shall be available and effective when you start to use the SOFTWARE and shall remain in effect for a period of two (2) months from that date, after which it shall automatically expire. If you wish to continue using the SOFTWARE after the expiration, you must purchase a separate license from SONY and/or OWNER.

12.2 Without prejudice to any of its other rights, SONY may terminate this T&Cs if you fail to comply with any of its terms. In case of such termination, you must cease all use, and destroy any copies, of the SOFTWARE.

12.3 The provision of Section 2.1, 3 through 12, and 14 of this Agreement shall survive in perpetuity.

13. AMENDMENT

SONY RESERVES THE RIGHT TO AMEND ANY OF THE TERMS OF THIS T&Cs AT ITS SOLE DISCRETION BY POSTING NOTICE ON https:// tof-ar.com/ OR OTHER SONY DESIGNATED WEB SITE, OR BY EMAIL NOTIFICATION TO AN EMAIL ADDRESS PROVIDED BY YOU, BY PROVIDING NOTICE AS PART OF THE PROCESS IN WHICH YOU OBTAIN UPGRADES/UPDATES OR BY ANY OTHER LEGALLY RECOGNIZABLE FORM OF NOTICE. If you do not agree to the amendment, you should promptly contact SONY for instructions. Your continued use of the SOFTWARE after the effective date of any such notice shall be deemed your agreement to be bound by such amendment.

14. THIRD-PARTY BENEFICIARIES

Each THIRD-PARTY SUPPLIER is an express intended third-party beneficiary of, and shall have the right to enforce, each provision of this T&Cs with respect to the SOFTWARE of such party.

Accept