AIVON’s blockchain solution for analyzing metadata could help solve the global video search problem.
With more than a billion hours of video watched daily on YouTube alone (not including social platforms and streaming services), online video is the most consumed content on the web. It’s also the most difficult to search, creating a host of problems for content and service providers, advertisers and consumers.
Now comes AIVON, an open source video network using artificial intelligence and human experts to create a decentralized video search engine and API protocol that any company or person can use for better search, discovery and accessibility of video content thru metadata.
Through data analyzed and incentivized by AIVON’s token ecosystem, the AIVON network produces 10x more metadata (i.e. face, emotion, object, event, brand recognition, etc.) per video scene than current systems. More organized data means better results and opportunities for ad tech, rights management, content creation clipping, brand safety, digital fingerprint and forensics, tagging and indexing, ad search, content matching and recommendation engine, analytics and more.
AIVON is solving a “finding what you don’t know what to look for” problem. AIVON helps surface things that might be more embedded and harder to find.
Last but not least, incentivization: Platform participants can either run mining nodes or provide expertise and be rewarded with AIVON tokens. AI Computer Vision algorithms running on mining nodes using CPU/GPU resources will be used to scan media files, generate enhanced metadata, including time-coded tags, classification, categories, transcripts and translations, and an index of the video objects.
Humans with expertise in tagging, editing and translation can participate in the AIVON shared economy to help with the verification, validation and/or creation of video metadata. AI Machine Learning algorithms will continually learn from the actions of AIVON community to become better and smarter. AIVON will empower the community with tools to enable the community to moderate, review, verify the meta-tags, categorize, transcribe and/or translate content, as well as provide economic incentives to encourage this activity thru AIVON tokens.
CEO Rex Wong answered a few Block Tribune questions:
BLOCK TRIBUNE: How do you visualize people using this service?
REX WONG: Requestors, such as Content Owners and Service Providers, can upload content via our Web Portal, PC/Mac apps, mobile apps and/or our Open API. Their requests will go to our decentralized community of users who will perform one of three tasks – AI Compute, Human Expert Training & Verification and Validation. They will be incentivized and compensated via AIVON tokens. For AI Compute, uploaded content is run through our AI scene level detection to generate industry-standard video metadata. The metadata is then confirmed via our human experts to ensure all information is rich and up-to-standard. As metadata is validated, its corresponding hashed value will be published onto the blockchain.
One of the first DApps to be built on top of the AIVON protocol will be an Open Video Search Engine that will offer a transparent and ubiquitous index and search engine for online video curated and maintained by the community. Currently, there is no actual Video Search Engine that exists. Most people believe YouTube is a video search engine but it is actually a centralized, video hosting and streaming platform and its index of videos is limited to videos that users upload. Major media companies and premium content owners are wary of uploading their content to YouTube and/or licensing their content to Amazon or Netflix and other similar centralized sites/portals because they fear losing their brand identity and connection with their users. They want users to come to their own sites and this is the driver for recent events such as Disney pulling their content from Netflix and launching their own video sites.
Yet, many independent sites will fracture and fragment video discovery and accessibility as users will have a more difficult time trying to find and discover content amongst a sea of video sites. Therefore, a decentralized video search engine is needed that allows metadata to be acquired and aggregated in a distributed and decentralized way, which blockchain technology enables, while offering transparency as well as protection of content rights through an immutable content ownership record, which is validated and recorded on a public blockchain for all to see and inspect.
Content Owners will also be more comfortable submitting their content metadata to an open video search engine, as opposed to uploading the content itself such as YouTube, to allow users to find content and for Content Owners to keep control of their content and drive traffic to their own video sites and apps.
BLOCK TRIBUNE: Will this be the main go-to search tool, or an adjunct for deeper dives?
REX WONG: We are hoping with standard and normalize video metadata, decentralized applications built on top of our AIVON protocol, such as the Open Video Search Engine, can be developed to allow users to search video easily with keywords, titles, celebrities, brands, products, and even a phrase said during a video/movie. The Open Video Search Engine can truly allow users to take deeper dive on their searches and find their desired video content. With standard and normalized video metadata, video content discovery and monetization will be easier for users, content producers/owners and distribution channels.
BLOCK TRIBUNE: How can content publishers leverage this tool?
REX WONG: Publishers include online media companies, mobile operators or video apps. In addition, content publishers can leverage such tools to better understand their audiences desires and to generate content that matters to them.
Publishers can use the tokens to pay Content Owners for licensing content via Content Marketplace DApps to discover, access and license relevant content. Users can use the token to pay for content offered by Content Publishers. Publishers can use tokens as an incentive to Content Producers to upload popular short tail. The token can also be used as an incentive for users to opt in or share more information.
BLOCK TRIBUNE: How can advertisers use it?
REX WONG: Advertisers include Brands, Agencies, SMEs & Government. Advertisers can use the tokens to pay for advertising on the AIVON Advertising Network and Exchange to search and buy placement on appropriate brand safe content. They can also use the tokens to pay for access to the AIVON Marketplace to search and discover appropriate Content Producers to create sponsored content.Advertisers are constantly discovering and searching for the best advertising spaces to capture their ideal target audience at the right time, right moment, and right context. In the space of video advertising, it is hard for advertisers to sometimes accurately serve the right ad to their audience due to the lack of information of the video. Therefore, with standard and normalized video metadata, advertisers can easily reach their target audience with relevant data at their fingertips.
BLOCK TRIBUNE: The community has incentives to monitor the AI – but won’t they eventually dwindle as the AI becomes more powerful?
REX WONG: The community input will be awarded via AIVON tokens. These block rewards will average 5% more tokens each year for the next 10 years, up to a maximum of 1 billion tokens. These block rewards will be split 3 ways: (a) AI nodes, (b) validators and (c) our foundation. The foundation will have a decreasing participation from 25% to zero over the first 5 years. AI nodes and validators will split the balance equally. The power of AI still requires a lot more data from humans to analyze which will take a substantial amount of time and effort. Although AI will become more powerful, the need for AI nodes will also drastically increase to accommodate the demand for AI.
The users can do the following with AIVON tokens:
● Earn tokens by participating in the Human Expert network or AI node network to provide verification or editorial services.
● Reward with token by the publishers or Advertisers for viewing or interacting with Ads.
● Earn more tokens by opting-in to provide more user data powered by IVS
● Donate or gift token to support their favorite Content Producers or Publishers
BLOCK TRIBUNE: Will the service allow people to clip soundbytes or other visuals in order to create mash-ups?
REX WONG: This is definitely possible but it all depends on the rights given by the Content Owners. We believe some Content Owners may allow registered users to view, distribute, and edit their content based on certain parameters. Besides generating metadata, AIVON also uniquely tags all video assets to protect the digital assets of our users. One of the biggest issues revolving around video content is digital rights management, which AIVON takes very seriously.
BLOCK TRIBUNE: What industries will be impacted by your success in the near term and the future?
REX WONG: Industries that may be impacted by our success includes advertising, D2C Video Platforms, Digital Rights Management and Content Distribution channels. With blockchain technology, decentralizing video encoding, storage, and content distribution will dramatically reduce the cost of video traffic by tapping into $30 billion in wasted Internet computing services.
Please refer to the full article for more information.