Image transfer delay from robot camera to visionpro under local network transmission #52

Activity

1. horizoneee commented on Feb 13, 2025

   

   horizoneee

   on Feb 13, 2025

   Author

   More actions

   async def main_image(self, session, fps=60):
   session.upsert @ Hands(fps=fps, stream=True, key="hands", showLeft=False, showRight=False)
   end_time = time.time()
   while True:
   start = time.time()
   display_image = self.img_array

           session.upsert(
           [ImageBackground(
               # Can scale the images down.
               display_image[::2, :self.img_width],
               # display_image[:self.img_height:2, ::2],
               # 'jpg' encoding is significantly faster than 'png'.
               format="jpeg",
               quality=80,
               key="left-image",
               interpolate=True,
               # fixed=True,
               aspect=1.66667,
               # distanceToCamera=0.5,
               height = 8,
               position=[0, -1, 3],
               # rotation=[0, 0, 0],
               layers=1, 
               alphaSrc="./vinette.jpg"
           ),
           ImageBackground(
               # Can scale the images down.
               display_image[::2, self.img_width:],
               # display_image[self.img_height::2, ::2],
               # 'jpg' encoding is significantly faster than 'png'.
               format="jpeg",
               quality=80,
               key="right-image",
               interpolate=True,
               # fixed=True,
               aspect=1.66667,
               # distanceToCamera=0.5,
               height = 8,
               position=[0, -1, 3],
               # rotation=[0, 0, 0],
               layers=2, 
               alphaSrc="./vinette.jpg"
           )],
           to="bgChildren",
           )
           # rest_time = 1/fps - time.time() + start
           end_time = time.time()
           await asyncio.sleep(0.03)
   
2. Junye-Chen commented on May 12, 2025

   

   Junye-Chen

   on May 12, 2025

   More actions

   @obito8065 I also met the same problem and my latency is even much higher than yours.
   I use the Meta Quest3 device and the LAN connection.
   Have u solve this problem?
3. horizoneee commented on May 12, 2025

   

   horizoneee

   on May 12, 2025

   Author

   More actions

   @obito8065 I also met the same problem and my latency is even much higher than yours. I use the Meta Quest3 device and the LAN connection. Have u solve this problem?
   I didn't solve this problem completely, I harvested some experience through a lot of experiments for your reference: first of all, this network latency is related to your network, you need to check your network latency first. I encountered the problem of smooth video in the morning and laggy video in the afternoon. Also, standing closer to the signal source works a little better, all the above problems I think are due to avp's network latency issues. Secondly, when I use it, when refreshing the web page, I don't enter it immediately, but wait for the video in the window to stabilize (may be 1s, may be more than 10s) and then click ENTER, so that the video will play normally and smoothly! Hope the above suggestions help you.
4. Junye-Chen commented on May 12, 2025

   

   Junye-Chen

   on May 12, 2025

   More actions

   @obito8065 Thank you very much for your kindness!
   The second advice is really helpful and I also find that when using a lower resolution can alleviate this problem.