Sonsivri
 
*
Welcome, Guest. Please login or register.
Did you miss your activation email?
December 07, 2024, 01:31:32 01:31


Login with username, password and session length


Pages: [1] 2  All
Print
Author Topic: My hobby  (Read 10389 times)
0 Members and 1 Guest are viewing this topic.
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« on: February 22, 2023, 08:46:12 20:46 »


I am developing music visualization technology. It is designed to create stand-alone devices that can analyze music in real time and synthesize visual images.

Here are a couple of links to a video where a simplified version of the visualizer was created, you can use them to evaluate the quality of the conversion.


https://youtu.be/rPzrPmGo2O8

https://youtu.be/YSM8j3g1Uy0


Logged
pushycat
Senior Member
****
Offline Offline

Posts: 463

Thank You
-Given: 213
-Receive: 1448



« Reply #1 on: February 23, 2023, 09:15:34 09:15 »

Excellent idea and Nice concept for Discotheques and Dance floors.
Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #2 on: February 23, 2023, 09:23:22 09:23 »

For a DJ's workplace, I think this device will be a must soon. Cheesy
Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #3 on: February 23, 2023, 09:16:33 21:16 »

Several photos of the music visualizer itself:










Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #4 on: February 24, 2023, 05:54:19 17:54 »


This is the third clip demonstrating the capabilities of the technology.
CLUBBEST is a variant of 1D implementation of RTMV-technology.
CLUBBEST can be used with amazing success in the DJ workplace.



https://youtu.be/jjfVmc3wkeI

Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #5 on: March 05, 2023, 08:29:54 20:29 »


CLUBBEST M68R21 and CLUBBEST P68R21

This video demonstrates how the renderer and repeater work together.

https://youtu.be/cg4K0_IGmsA

Enjoy.



Logged
sphinx
Hero Member
*****
Offline Offline

Posts: 918

Thank You
-Given: 614
-Receive: 270



« Reply #6 on: March 05, 2023, 08:54:07 20:54 »

imagination is the one that will let you dreate more of the light schemes
Logged

laws of physics are not laws at all, just assumptions and formulas that work as long as we don't figure something new that wrecks the calculations. the infinite onion try to peel that one
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #7 on: March 07, 2023, 08:33:41 20:33 »



https://youtu.be/6Sml7a7JSnQ

CLUBBEST RTMV-technology

Visualization of music in real time!

Armin van Buuren feat. Wrabel - Feel Again (Official Video)

Enjoy.
Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #8 on: March 10, 2023, 05:06:53 05:06 »

To live music - you need live light!


https://youtu.be/3i8zawaxgM0





« Last Edit: March 10, 2023, 05:12:49 05:12 by Catcatcat » Logged
OscarH
Junior Member
**
Offline Offline

Posts: 50

Thank You
-Given: 158
-Receive: 18


« Reply #9 on: March 10, 2023, 09:39:51 09:39 »

CatCatCat, the outcome effect is really excellent.
Would you mind sharing, without detailling any internal secret, what is the approach you used to have sound converted into these nice effects ?
Cheers.
Logged

All mushrooms are edible. At least once...
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #10 on: March 10, 2023, 01:15:23 13:15 »

I immediately apologize for my English, but I will try to tell you about my, as I call it, RTMV-technology.

You will agree with me that lighting, in any show, is as important as the music.

For grandiose shows, a light part is written specifically for lighting fixtures, which has synchronization with a piece of music. For this, as I think,
 there is already such a profession as a lighting engineer.

A lighting engineer such as a composer of light, a lighting artist. And talented people create really amazing lighting works. But there is one thing, but.
All this is done for one performance, for one SHOW. If such a light SHOW is viewed several times, it begins to “pall” with experience and the person
experiences disappointment, i.e. comes the so-called - the effect of fatigue.

But I think the demand for the light accompaniment of a musical work is quite large. There is only no theory that could describe the principles by which
it is possible to create such an instrument or device that could, without human intervention, in real time transform music into Light Images.

Yes, according to the very first ideas, in world history, in which there was an attempt to visualize music, it was always about creating light images.

For everyday purposes, of course, no one will invite a lighting engineer to write a light part for one track. For household devices or for instruments,
for example, a DJ workplace, a device is needed that can enhance the perception of a piece of music and at the same time be completely autonomous and not create the so-called fatigue effect.

The effect of fatigue is associated with the characteristics of a person, human memory can remember a lot of visual information and devices with
a limited algorithm easily, literally in a week, visualizations become unattractive.

What CLUBBEST is is a simplified version, 1D visualization, it uses simplified algorithms that MCU with 15 MIPS performance can implement. A big
limitation is already imposed by the use of WS2812, 8 bits per channel and color limitation, the need to implement a non-standard interface,
low data transfer rate.

The CLUBBEST architecture was chosen from the technical capabilities that I could get on the territory of Ukraine and using the assembly capabilities
in China (but now it’s very sad, the Chinese have now closed the possibility of selling components and assembling printed circuit boards for Ukraine,
being afraid to fall under sanctions).


The whole project was conceived to be an inexpensive device that could be connected to a PC, home theater or DJ console quickly and easily,
it should not have any manual adjustments, all processing should be completely automatic and have acceptable visualization.

If frankly, not everything is as simple as it looks. Even the shape of the rise and fall of light plays a big role in perception. And all these small
features require additional MCU performance.

There are interesting things, the human brain, depending on what color he saw, then after it is extinguished, he can finish painting a completely
different color afterglow.

There is such a thing - what a person considers beautiful. For example, if the image of the image is symmetrical, it is always beautiful.

Rhythm has a very important place in a piece of music. But in any rhythmic music there is a melody. Here I am trying to implement the solution
to these problems in RTMV-technology. Of course, I practice at an amateur level and in my free time from the state of survival that is now in Ukraine.
For such studies, one must devote 100% of the time to have good equipment for sound analysis. But as practice has shown, even in such a limited
implementation, RTMV-technology shows good results.

Now for the CLUBBEST option - two models have been created:

CLUBBEST M68 Master and Slave. This is the synthesizer itself and the repeater module, purely an additional screen. In the video, they stand
on a rack one above the other. But there are "legs" for each module separately and they can be placed to the left and to the right of the viewer.
If used in such a variant as in the video, CLUBBEST should be placed in front of the viewer and always horizontally, this is important for perception.

The second option is CLUBBEST M100, everything is almost the same for everyone, but it has much more, the so-called “visualization matrices”
 are generated and its perception of its visualization is more saturated.
The main advantage of such a music visualization tool is the resulting low cost, and if you organize its mass production, then you can get
a good profit at the level of $ 200-300 per product.

Disadvantages, of course, there are many of them, and all of them are associated so far with the impossibility of implementing full-fledged
RTMV-technology algorithms on the material base I have.

Well, here's the problem - the WS2812 has a too slow data bus, with large numbers, the synchronization pulse becomes so large that it really
slows down the visualization.
http://www.normandled.com/Download/index.html

For such purposes, it is more efficient to use, for example APA102, they use the ala-SPI interface. And modern options allow you to transfer
data at speeds up to 40 MHz, and this is not 800 kHz like the WS2812 and with small arrays of LEDs.
https://www.addressableledstrip.com/home/download/index/catId/17.html

The next one is 8 bits, which is very, very small. Now there are 16-bit LEDs such as HD108 or NS108, in these LEDs you can get amazing
color components, but for such purposes, processing speeds of 600MIPS or more are needed.

Maybe there will be a sponsor who will be interested in this topic, then such a CLUBBEST visualizer will appear for anyone who is fond of
and appreciates music. But so far, only individual orders and the manufacture of single copies are a little expensive.



If you are interested, you can see my development steps on my channel https://youtube.com/@CatcatcatElectronics

The main idea behind the technology is to see the music!



« Last Edit: March 10, 2023, 01:19:43 13:19 by Catcatcat » Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #11 on: March 11, 2023, 03:11:01 15:11 »






Logged
sphinx
Hero Member
*****
Offline Offline

Posts: 918

Thank You
-Given: 614
-Receive: 270



« Reply #12 on: March 11, 2023, 03:41:16 15:41 »

i sure hope you have protected the internal program well from those pescy chinese copy makers, i havent read up on the latest copy protection
in mcu how good it is now days
Logged

laws of physics are not laws at all, just assumptions and formulas that work as long as we don't figure something new that wrecks the calculations. the infinite onion try to peel that one
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #13 on: March 26, 2023, 08:15:08 20:15 »


https://youtu.be/DxsV6PKaVgA
Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #14 on: March 31, 2023, 08:27:25 20:27 »

Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #15 on: May 16, 2023, 06:06:01 06:06 »

Miss Monique - Special B'day Podcast 2023 | Real-time Music Visualization



CLUBBEST M100 Master


« Last Edit: May 16, 2023, 06:14:20 06:14 by Catcatcat » Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #16 on: June 04, 2023, 08:50:40 08:50 »




CLUBBEST M100 Master
Real-time Music Visualization









« Last Edit: June 04, 2023, 08:52:49 08:52 by Catcatcat » Logged
LabVIEWguru
Senior Member
****
Offline Offline

Posts: 300

Thank You
-Given: 273
-Receive: 593



« Reply #17 on: June 04, 2023, 11:25:50 23:25 »

Thank you for sharing your work with us. It is incredible! in the 1970's I built my wife (then my girlfriend) a box with dozens of op-amps (band pass filters)  driving transistors that drove colored Christmas tree lights. It was nothing compared to your videos. Very cool! Who is the beautiful blonde in the video?
Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #18 on: June 05, 2023, 07:56:23 07:56 »


Construction of CLUBBEST M68 MASTER, here you can download 3D pdf to view the construction of the tool https://catcatcat.d-lan.dp.ua/download/construction-clubbest-m68-master/




Link to podcast https://youtube.com/playlist?list=PLOZmwe3zikuEjKRgyJdcH6FsxC2ABKJyJ


« Last Edit: June 05, 2023, 07:59:28 07:59 by Catcatcat » Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #19 on: June 07, 2023, 07:55:17 07:55 »




Light visualization of music has an especially amazing effect on a person in the evening and at night. Light visualization greatly enhances the perception of a piece of music, and with this you will undoubtedly agree with me.


From my point of view, the most difficult option is the visualization of classical and instrumental music, which is intended for relaxation and meditation.

To demonstrate how the technology works, this video:

https://youtu.be/UiUCdR6w71E


Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #20 on: June 12, 2023, 07:00:12 07:00 »


CLUBBEST vs BEAMZ Light Show | Real-time Music Visualization

Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #21 on: June 29, 2023, 08:51:19 20:51 »



Mariage d'Amour - Paul de Senneville || Jacob's Piano | Real-time Music Visualization





https://youtu.be/r4WWYsavhFw


Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #22 on: July 08, 2023, 03:40:59 15:40 »

The art of DJ
The art of DJ has gained wide popularity. Today, a DJ is not just someone whose task is to mix tracks; a DJ is now a composer who creates new music. The art of DJing involves live sets where the main task is to mix tracks and arrange music, adding musical fragments and sound effects in real time. The art of DJing is about direct communication with the audience through live music.

Lighting has become an integral part of a DJ's life during sets. It is undeniable that lighting enhances the atmosphere and perception of a musical piece. Lighting can even dramatically alter the perception of the music itself. However, there is a flip side to the coin. If the lighting is not synchronized and does not correspond to the musical piece, it can have a negative effect. Therefore, the key aspect of using lighting in a musical performance is the seamless connection between the music and the lights.

Many lighting equipment manufacturers have started producing lighting controllers for mobile DJs, which allow them to control their lighting fixtures. All these controllers operate on the same principle: you need to write a sequence of commands to control your lighting devices and save this control program in advance. During the set, you can launch the visualization program for your show. To achieve maximum impact from the music visualization, it is necessary to create a separate lighting composition for each track. Audio features allow you to synchronize the lighting program with the music track in one way or another. Additionally, while operating the lighting controller, you can manually switch settings and control additional devices such as smoke machines and strobes.


But this approach has significant drawbacks:

1.   DJs have to constantly come up with new lighting sequences to control the lighting fixtures because using the same sequence repeatedly can annoy the audience, even when playing the same musical track.
2.   A unique lighting control sequence written for a specific musical track may not be suitable for another musical piece.
3.   Such lighting controllers are highly inefficient for live music. DJs are creative individuals, and during a performance, they need to focus on the music. The modern approach with such controllers distracts DJs from their main task. That's why in popular DJ sets today, lighting effects are often absent.
4.   Lack of a real connection between the created lighting patterns and the music flow. Synchronization mechanisms are imperfect and often simply don't work.

Manufacturers of modern lighting controllers for mobile DJs mainly focus on creating compact, modern designs in a new style. These controllers typically have illuminated buttons, encoders, and a graphical display, but there are no revolutionary innovations in these consoles. The only desire of the manufacturer is to present existing visualization principles differently and package them in a new way.

I believe that DJs need lighting equipment with intelligent capabilities that can independently create music visualization in real-time. Such equipment should allow DJs to fully concentrate on the music. The key feature of such a system should be a visible connection between the visual elements and the musical composition. The ideal scenario would be when the music itself generates the light show.

I have spoken to so-called lighting technicians whose task is to create light shows for concerts, and they assure me that creating such devices is impossible and that it is a creative process beyond the reach of electronics. Talented lighting technicians are artists in their field and create stunning light shows, but even in those cases, the shows are often one-time events. Furthermore, I have never seen a "good" synchronization of light and music, which is sometimes disappointing. Most often, such light shows consist of a combination of various lighting effects, running lights, strobes, all mixed together in the hope that somewhere, somehow, it will align with the music and look good.


For a DJ who uses live music in their work, using a pre-programmed composition approach is impractical, and hiring a lighting engineer is simply unrealistic. That's why we often see that the lighting used in DJ performances has little to do with the music.

Humanity has long noticed that music has the ability to evoke visual imagery in the human mind, and that's why light shows have become an integral part of any music concert or performance.

I have dedicated all my free time to a hobby that involves developing real-time music visualization systems. Initially, I built many devices based on existing schematics and created output optical devices within my financial means. But the result of these efforts always led to the same outcome: the newly constructed device would initially bring excitement with its variety of effects, but after a few days, it would no longer bring joy, and within a few weeks, interest in it would simply fade away. This effect is known as visual fatigue, which is due to the human brain visually memorizing a lot of information and requiring constant refreshing.

From my own experience, I concluded that the existing approach to building automatic devices that can visualize music in real time does not correspond to reality. New rules, theories, and technological principles are needed to offer a fresh perspective on music visualization. According to these principles, it would be possible to create devices capable of automatically visualizing music in real time without human intervention. Moreover, I want to emphasize that such devices should have algorithms that allow for the creation of visual arrangements for melodies, which would generate new visualizations each time the same musical composition is played, eliminating the effect of visual fatigue.

I am not a musician; I simply love listening to music, but I am a fan of music visualization. That's why I embarked on a path where I defined the fundamental principles that music visualization represents to me. I named these principles "Real-Time Music Visualization Technology" or, in short, RTMV-technology.

Basic principles

1.   In any musical composition, there are two components: melody and rhythm.
2.   Melody is a smooth element that resembles a wave, threading through the entire musical piece.
3.   Rhythm, or pattern, can include a solo instrument, the singer's voice, and of course, the rhythm itself. It is the dynamic component of the musical composition.
4.   The visualization algorithm should execute a "light arrangement" of the musical piece. What does this mean? It should create a new visualization each time the same musical composition is played. The visualization algorithm should be somewhat intelligent.
5.   The Output Optical Device (OOD) can be a screen or a set of various light sources positioned in space, both in relation to each other and the audience.
6.   The principle of symmetry is the principle of beauty. I came to this realization when creating output optical devices or determining the placement of lighting fixtures on stage. If the generated light patterns have symmetry, it is always perceived as beautiful. If you look at all the light installations, you will see that the principle of symmetry is present everywhere.
7.   The algorithm of the music visualization system should be fully autonomous. The algorithms should independently determine the style of the musical composition and create control sequences to manage the lighting fixtures accordingly.
8.   The frequency analysis mechanism should distinguish one note from another.
9.   The main requirement of RTMV-technology is the principle of creating light patterns. Light patterns should have a visible connection to the musical composition, which means that the visualization should be linked and synchronized with the music. In other words, the music itself should create the visualization. Each light pattern created by RTMV-technology should be derived from the melody and rhythm of the musical composition.

Based on these principles, I began developing algorithms and designing controllers. When designing such devices, the format of the digital data required for music visualization is determined by the light sources used in the light show. The most accessible light sources for me were LEDs. With the advent of LEDs with built-in drivers, they became the primary means of visualization. This does not mean that RTMV-technology cannot be used with modern stage devices. It means that it requires a description of additional control functions for a specific lighting fixture or group, and nothing more.

Initially, for music visualization, I intended to use a 2D screen, and the development of RTMV-technology was focused on this type of screen. When the development process reached a certain level, it was necessary to create a working prototype to showcase the idea for objective feedback. Obtaining feedback is an important step as it allows you to look at the results of your work in a new way and go beyond your subjective understanding of reality. However, it turned out that creating a prototype for the 2D version required significant financial resources that I could not allocate from my income. Without demonstrating a working device, finding an interested sponsor or lighting equipment manufacturer seemed impossible.

I decided to deviate from the chosen direction and create a series of music visualization devices, similar to sound level indicators (VU meters), in order to earn the necessary startup capital. However, none of the solutions I created satisfied me. I tried adding more lighting effects, but it always ended up with the same nagging issue of visual fatigue. In other words, after a certain period of time, the device would become boring, uninteresting, and unappealing. This contradicted the goal of my work. That's when I decided to apply a simplified version of RTMV-technology for a linear-type display. A linear display involves arranging uniform light sources in a straight line, and this variant became known as 1D visualization. The initial results of testing pleased me greatly. You see, at the beginning of developing RTMV-technology, I rejected the concept of 1D visualization, believing that it would not be able to create sufficiently effective light patterns. However, as the experiment showed, it is possible and can be achieved at a sufficiently high level of efficiency.

This project was named CLUBBEST. Prototypes of two types of visualizers, models M68 and M100, were developed and manufactured. They differ in the type and quantity of LEDs used, as well as the approach to the data visualization mechanism. The primary purpose of these models was for personal, home use. Personally, I intended these projects as decorative devices for listening to music on one's PC. However, the feedback showed that this visualization approach also interested music professionals. To popularize the concept, I started recording videos demonstrating the devices' real-time operation, aiming to gather more information about the perception of this new form of art. And I began receiving positive feedback. The most inspiring feedback for me was when a subscriber of my YouTube channel wrote, "I felt like I saw the music." Yes, that's the truth - I am developing this technology so that people can see music.

Take note of how well-known lighting equipment manufacturers approach showcasing new technologies or visualization systems. They advertise and create promotional videos in an interesting way. In their videos, they provide extensive and sometimes even tedious descriptions of the new device, its unique features and capabilities, the number of new connectors, beautiful buttons, convenient encoders, and now, even OLED displays. They talk about how many lighting control sequences can be programmed into this new device, without mentioning the additional hours of work required. And most of the time, there are no real video demonstrations of the device's operation with lighting fixtures, or at best, a maximum of 10 seconds of demonstration. Why is that? It's because there's simply nothing worth watching beyond 10 seconds, as not much novelty has been developed for such devices. And for some reason, everyone remains silent about the fact that using this approach to visualization leads to the well-known effect of visual fatigue.

I believe that for a DJ, especially a mobile DJ, it is important to know how convenient, efficient, and user-friendly the newly acquired equipment will be. They need to consider how the use of this equipment will simplify their lives with lighting fixtures and not distract them from their primary focus on music. Moreover, this new device should aid them in their musical creativity. A DJ, after creating a musical composition, should be able to immediately see its visualization in real time. Unfortunately, the modern technologies offered by contemporary brands do not allow them to do so.

To evaluate the performance of the new visualization technology and demonstrate its objectivity, I create promotional videos by recording the entire musical composition. Please note that I don't edit the videos to include only specific moments. I aim to provide information about the real-time operation of the music visualization mechanism, showing the visualization results throughout the entire musical composition and highlighting the connection between light and music. Even in live broadcasts, I try to show a 5-10 minute segment of video to assess how effective a DJ's performance would be if accompanied by visualization. I record visualizations with different musical styles to demonstrate how the technology handles different types of music. Music is meant to be heard, while visualization is meant to be seen. The visualization should be of such quality that it gives the impression that the sound is coming not only from the speakers but also from the light itself.

CLUBBEST is built on the principle of "Plug and Play." You only need to feed the audio signal, and RTMV-technology takes care of everything else. CLUBBEST does not have a single adjustment knob. It automatically identifies the musical style and generates visual effects synchronized with the music on the available output optical device. In the CLUBBEST project, everything is simplified, with the light sources having consistent characteristics and a fixed quantity. Therefore, the algorithm is simplified and designed specifically for this configuration of the output optical device.

It's important to note that CLUBBEST is a highly simplified version of RTMV-technology, but the prototypes already developed can serve as a foundation for creating a range of serial products for mobile DJs and individual consumers to enhance their music listening experiences.


Furthermore, these systems that utilize real-time music visualization have a wide range of applications in clubs, cafes, bars, and restaurants where music is played and the venue owner wants to add dynamic lighting to attract visitors' attention.

Approaching the use of RTMV-technology for controlling stage lighting fixtures, the resulting lighting console would have one main feature that distinguishes it from modern consoles: it won't have a tedious programming mechanism for lighting control sequences. RTMV-technology is about music itself creating the light visualization.

The initial configuration of such a lighting console may involve visually describing the lighting fixtures to be used and their spatial arrangement. Currently, RTMV-technology allows for 1D and 2D arrangements of lighting fixtures in space. Theoretically, a 3D variant is also possible, but I have not yet defined those requirements for myself.

For a user (DJ), how would the connection of lighting fixtures look? You simply need to select the type of symmetry used in the visualization, specify the type (brand, model) of the light sources, and indicate their spatial positions according to certain rules. That's all for the setup. For more advanced users, there will be additional options for customization, such as limiting the rotation angle or maximum brightness of the light source, and similar parameters.

The preliminary configuration for RTMV-technology is necessary for the system to understand which control parameters need to be generated for managing the connected lighting fixtures. After that, the user simply connects to the audio source, and the light show begins.

Modern music visualization technology involves the process of pre-creating and programming a light composition for music, taking into account the lighting fixtures used. I believe this is a separate direction intended for lighting artists and represents a distinct form of art with its right to exist and develop.

However, it's time for a new form of art - the art of algorithms and electronics. This kind of music visualization art envisions a scenario where composers, while creating their musical compositions, also determine the accompanying light show and the visual representation of their musical works. But to achieve that, they need entirely different music visualization tools.

Now is the time to develop and create so-called intelligent real-time music visualization tools.

Here's one opinion that recognizes my point, providing further confirmation that the time has come:
AI DMX Lighting for DJ's | No More Programming DMX Shows
https://www.youtube.com/watch?v=pZZiAXjMOsw

After watching the previous video, click here to see how RTMV-technology works, and you will fully agree with me - The time has come!
https://www.youtube.com/watch?v=dESf7xZzE1g&list=PLOZmwe3zikuEjKRgyJdcH6FsxC2ABKJyJ

Catcatcat Electronics,
Dnipro, Ukraine, 2023

Logged
Unhappy
Senior Member
****
Offline Offline

Posts: 282

Thank You
-Given: 1005
-Receive: 101


« Reply #23 on: July 19, 2023, 04:07:52 04:07 »

The art of DJ
The art of DJ has gained wide popularity. Today, a DJ is not just someone whose task is to mix tracks; a DJ is now a composer who creates new music. The art of DJing involves live sets where the main task is to mix tracks and arrange music, adding musical fragments and sound effects in real time. The art of DJing is about direct communication with the audience through live music.

Lighting has become an integral part of a DJ's life during sets. It is undeniable that lighting enhances the atmosphere and perception of a musical piece. Lighting can even dramatically alter the perception of the music itself. However, there is a flip side to the coin. If the lighting is not synchronized and does not correspond to the musical piece, it can have a negative effect. Therefore, the key aspect of using lighting in a musical performance is the seamless connection between the music and the lights.

Many lighting equipment manufacturers have started producing lighting controllers for mobile DJs, which allow them to control their lighting fixtures. All these controllers operate on the same principle: you need to write a sequence of commands to control your lighting devices and save this control program in advance. During the set, you can launch the visualization program for your show. To achieve maximum impact from the music visualization, it is necessary to create a separate lighting composition for each track. Audio features allow you to synchronize the lighting program with the music track in one way or another. Additionally, while operating the lighting controller, you can manually switch settings and control additional devices such as smoke machines and strobes.


But this approach has significant drawbacks:

1.   DJs have to constantly come up with new lighting sequences to control the lighting fixtures because using the same sequence repeatedly can annoy the audience, even when playing the same musical track.
2.   A unique lighting control sequence written for a specific musical track may not be suitable for another musical piece.
3.   Such lighting controllers are highly inefficient for live music. DJs are creative individuals, and during a performance, they need to focus on the music. The modern approach with such controllers distracts DJs from their main task. That's why in popular DJ sets today, lighting effects are often absent.
4.   Lack of a real connection between the created lighting patterns and the music flow. Synchronization mechanisms are imperfect and often simply don't work.

Manufacturers of modern lighting controllers for mobile DJs mainly focus on creating compact, modern designs in a new style. These controllers typically have illuminated buttons, encoders, and a graphical display, but there are no revolutionary innovations in these consoles. The only desire of the manufacturer is to present existing visualization principles differently and package them in a new way.

I believe that DJs need lighting equipment with intelligent capabilities that can independently create music visualization in real-time. Such equipment should allow DJs to fully concentrate on the music. The key feature of such a system should be a visible connection between the visual elements and the musical composition. The ideal scenario would be when the music itself generates the light show.

I have spoken to so-called lighting technicians whose task is to create light shows for concerts, and they assure me that creating such devices is impossible and that it is a creative process beyond the reach of electronics. Talented lighting technicians are artists in their field and create stunning light shows, but even in those cases, the shows are often one-time events. Furthermore, I have never seen a "good" synchronization of light and music, which is sometimes disappointing. Most often, such light shows consist of a combination of various lighting effects, running lights, strobes, all mixed together in the hope that somewhere, somehow, it will align with the music and look good.


For a DJ who uses live music in their work, using a pre-programmed composition approach is impractical, and hiring a lighting engineer is simply unrealistic. That's why we often see that the lighting used in DJ performances has little to do with the music.

Humanity has long noticed that music has the ability to evoke visual imagery in the human mind, and that's why light shows have become an integral part of any music concert or performance.

I have dedicated all my free time to a hobby that involves developing real-time music visualization systems. Initially, I built many devices based on existing schematics and created output optical devices within my financial means. But the result of these efforts always led to the same outcome: the newly constructed device would initially bring excitement with its variety of effects, but after a few days, it would no longer bring joy, and within a few weeks, interest in it would simply fade away. This effect is known as visual fatigue, which is due to the human brain visually memorizing a lot of information and requiring constant refreshing.

From my own experience, I concluded that the existing approach to building automatic devices that can visualize music in real time does not correspond to reality. New rules, theories, and technological principles are needed to offer a fresh perspective on music visualization. According to these principles, it would be possible to create devices capable of automatically visualizing music in real time without human intervention. Moreover, I want to emphasize that such devices should have algorithms that allow for the creation of visual arrangements for melodies, which would generate new visualizations each time the same musical composition is played, eliminating the effect of visual fatigue.

I am not a musician; I simply love listening to music, but I am a fan of music visualization. That's why I embarked on a path where I defined the fundamental principles that music visualization represents to me. I named these principles "Real-Time Music Visualization Technology" or, in short, RTMV-technology.

Basic principles

1.   In any musical composition, there are two components: melody and rhythm.
2.   Melody is a smooth element that resembles a wave, threading through the entire musical piece.
3.   Rhythm, or pattern, can include a solo instrument, the singer's voice, and of course, the rhythm itself. It is the dynamic component of the musical composition.
4.   The visualization algorithm should execute a "light arrangement" of the musical piece. What does this mean? It should create a new visualization each time the same musical composition is played. The visualization algorithm should be somewhat intelligent.
5.   The Output Optical Device (OOD) can be a screen or a set of various light sources positioned in space, both in relation to each other and the audience.
6.   The principle of symmetry is the principle of beauty. I came to this realization when creating output optical devices or determining the placement of lighting fixtures on stage. If the generated light patterns have symmetry, it is always perceived as beautiful. If you look at all the light installations, you will see that the principle of symmetry is present everywhere.
7.   The algorithm of the music visualization system should be fully autonomous. The algorithms should independently determine the style of the musical composition and create control sequences to manage the lighting fixtures accordingly.
8.   The frequency analysis mechanism should distinguish one note from another.
9.   The main requirement of RTMV-technology is the principle of creating light patterns. Light patterns should have a visible connection to the musical composition, which means that the visualization should be linked and synchronized with the music. In other words, the music itself should create the visualization. Each light pattern created by RTMV-technology should be derived from the melody and rhythm of the musical composition.

Based on these principles, I began developing algorithms and designing controllers. When designing such devices, the format of the digital data required for music visualization is determined by the light sources used in the light show. The most accessible light sources for me were LEDs. With the advent of LEDs with built-in drivers, they became the primary means of visualization. This does not mean that RTMV-technology cannot be used with modern stage devices. It means that it requires a description of additional control functions for a specific lighting fixture or group, and nothing more.

Initially, for music visualization, I intended to use a 2D screen, and the development of RTMV-technology was focused on this type of screen. When the development process reached a certain level, it was necessary to create a working prototype to showcase the idea for objective feedback. Obtaining feedback is an important step as it allows you to look at the results of your work in a new way and go beyond your subjective understanding of reality. However, it turned out that creating a prototype for the 2D version required significant financial resources that I could not allocate from my income. Without demonstrating a working device, finding an interested sponsor or lighting equipment manufacturer seemed impossible.

I decided to deviate from the chosen direction and create a series of music visualization devices, similar to sound level indicators (VU meters), in order to earn the necessary startup capital. However, none of the solutions I created satisfied me. I tried adding more lighting effects, but it always ended up with the same nagging issue of visual fatigue. In other words, after a certain period of time, the device would become boring, uninteresting, and unappealing. This contradicted the goal of my work. That's when I decided to apply a simplified version of RTMV-technology for a linear-type display. A linear display involves arranging uniform light sources in a straight line, and this variant became known as 1D visualization. The initial results of testing pleased me greatly. You see, at the beginning of developing RTMV-technology, I rejected the concept of 1D visualization, believing that it would not be able to create sufficiently effective light patterns. However, as the experiment showed, it is possible and can be achieved at a sufficiently high level of efficiency.

This project was named CLUBBEST. Prototypes of two types of visualizers, models M68 and M100, were developed and manufactured. They differ in the type and quantity of LEDs used, as well as the approach to the data visualization mechanism. The primary purpose of these models was for personal, home use. Personally, I intended these projects as decorative devices for listening to music on one's PC. However, the feedback showed that this visualization approach also interested music professionals. To popularize the concept, I started recording videos demonstrating the devices' real-time operation, aiming to gather more information about the perception of this new form of art. And I began receiving positive feedback. The most inspiring feedback for me was when a subscriber of my YouTube channel wrote, "I felt like I saw the music." Yes, that's the truth - I am developing this technology so that people can see music.

Take note of how well-known lighting equipment manufacturers approach showcasing new technologies or visualization systems. They advertise and create promotional videos in an interesting way. In their videos, they provide extensive and sometimes even tedious descriptions of the new device, its unique features and capabilities, the number of new connectors, beautiful buttons, convenient encoders, and now, even OLED displays. They talk about how many lighting control sequences can be programmed into this new device, without mentioning the additional hours of work required. And most of the time, there are no real video demonstrations of the device's operation with lighting fixtures, or at best, a maximum of 10 seconds of demonstration. Why is that? It's because there's simply nothing worth watching beyond 10 seconds, as not much novelty has been developed for such devices. And for some reason, everyone remains silent about the fact that using this approach to visualization leads to the well-known effect of visual fatigue.

I believe that for a DJ, especially a mobile DJ, it is important to know how convenient, efficient, and user-friendly the newly acquired equipment will be. They need to consider how the use of this equipment will simplify their lives with lighting fixtures and not distract them from their primary focus on music. Moreover, this new device should aid them in their musical creativity. A DJ, after creating a musical composition, should be able to immediately see its visualization in real time. Unfortunately, the modern technologies offered by contemporary brands do not allow them to do so.

To evaluate the performance of the new visualization technology and demonstrate its objectivity, I create promotional videos by recording the entire musical composition. Please note that I don't edit the videos to include only specific moments. I aim to provide information about the real-time operation of the music visualization mechanism, showing the visualization results throughout the entire musical composition and highlighting the connection between light and music. Even in live broadcasts, I try to show a 5-10 minute segment of video to assess how effective a DJ's performance would be if accompanied by visualization. I record visualizations with different musical styles to demonstrate how the technology handles different types of music. Music is meant to be heard, while visualization is meant to be seen. The visualization should be of such quality that it gives the impression that the sound is coming not only from the speakers but also from the light itself.

CLUBBEST is built on the principle of "Plug and Play." You only need to feed the audio signal, and RTMV-technology takes care of everything else. CLUBBEST does not have a single adjustment knob. It automatically identifies the musical style and generates visual effects synchronized with the music on the available output optical device. In the CLUBBEST project, everything is simplified, with the light sources having consistent characteristics and a fixed quantity. Therefore, the algorithm is simplified and designed specifically for this configuration of the output optical device.

It's important to note that CLUBBEST is a highly simplified version of RTMV-technology, but the prototypes already developed can serve as a foundation for creating a range of serial products for mobile DJs and individual consumers to enhance their music listening experiences.


Furthermore, these systems that utilize real-time music visualization have a wide range of applications in clubs, cafes, bars, and restaurants where music is played and the venue owner wants to add dynamic lighting to attract visitors' attention.

Approaching the use of RTMV-technology for controlling stage lighting fixtures, the resulting lighting console would have one main feature that distinguishes it from modern consoles: it won't have a tedious programming mechanism for lighting control sequences. RTMV-technology is about music itself creating the light visualization.

The initial configuration of such a lighting console may involve visually describing the lighting fixtures to be used and their spatial arrangement. Currently, RTMV-technology allows for 1D and 2D arrangements of lighting fixtures in space. Theoretically, a 3D variant is also possible, but I have not yet defined those requirements for myself.

For a user (DJ), how would the connection of lighting fixtures look? You simply need to select the type of symmetry used in the visualization, specify the type (brand, model) of the light sources, and indicate their spatial positions according to certain rules. That's all for the setup. For more advanced users, there will be additional options for customization, such as limiting the rotation angle or maximum brightness of the light source, and similar parameters.

The preliminary configuration for RTMV-technology is necessary for the system to understand which control parameters need to be generated for managing the connected lighting fixtures. After that, the user simply connects to the audio source, and the light show begins.

Modern music visualization technology involves the process of pre-creating and programming a light composition for music, taking into account the lighting fixtures used. I believe this is a separate direction intended for lighting artists and represents a distinct form of art with its right to exist and develop.

However, it's time for a new form of art - the art of algorithms and electronics. This kind of music visualization art envisions a scenario where composers, while creating their musical compositions, also determine the accompanying light show and the visual representation of their musical works. But to achieve that, they need entirely different music visualization tools.

Now is the time to develop and create so-called intelligent real-time music visualization tools.

Here's one opinion that recognizes my point, providing further confirmation that the time has come:
AI DMX Lighting for DJ's | No More Programming DMX Shows
https://www.youtube.com/watch?v=pZZiAXjMOsw

After watching the previous video, click here to see how RTMV-technology works, and you will fully agree with me - The time has come!
https://www.youtube.com/watch?v=dESf7xZzE1g&list=PLOZmwe3zikuEjKRgyJdcH6FsxC2ABKJyJ

Catcatcat Electronics,
Dnipro, Ukraine, 2023



Do you have final Product?,
 I would like to construct it myself for personal use
Logged
Catcatcat
Senior Member
****
Offline Offline

Posts: 432

Thank You
-Given: 284
-Receive: 1655



WWW
« Reply #24 on: July 19, 2023, 06:04:50 06:04 »

Yes, I have.

I plan to publish a project of a simplified version for self-assembly in the near future.





Logged
Pages: [1] 2  All
Print
Jump to:  


DISCLAIMER
WE DONT HOST ANY ILLEGAL FILES ON THE SERVER
USE CONTACT US TO REPORT ILLEGAL FILES
ADMINISTRATORS CANNOT BE HELD RESPONSIBLE FOR USERS POSTS AND LINKS

... Copyright © 2003-2999 Sonsivri.to ...
Powered by SMF 1.1.18 | SMF © 2006-2009, Simple Machines LLC | HarzeM Dilber MC