Ajout d'une sorte de sous-titre à un mp4 avec ffmpeg

Question

J'ai un sous-titre (il ressemble certainement à cela), mais je ne sais pas comment l'ajouter dans un MP4 que je crée. D'abord un hexdump du sous-titre:

00000000 00 00 00 18 66 74 79 70 69 73 6f 36 00 00 00 00 |....ftypiso6....| 
00000010 69 73 6f 36 64 61 73 68 00 00 00 28 66 72 65 65 |iso6dash...(free| 
00000020 55 53 50 20 62 79 20 43 6f 64 65 53 68 6f 70 11 |USP by CodeShop.| 
00000030 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 |................| 
00000040 00 00 02 1d 6d 6f 6f 76 00 00 00 6c 6d 76 68 64 |....moov...lmvhd| 
00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 
00000060 00 00 00 00 00 01 00 00 01 00 00 00 00 00 00 00 |................| 
00000070 00 00 00 00 00 01 00 00 00 00 00 00 00 00 00 00 |................| 
* 
00000090 00 00 00 00 40 00 00 00 00 00 00 00 00 00 00 00 |....@...........| 
000000a0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 
000000b0 00 00 00 02 00 00 01 81 74 72 61 6b 00 00 00 5c |........trak...\| 
000000c0 74 6b 68 64 00 00 00 07 00 00 00 00 00 00 00 00 |tkhd............| 
000000d0 00 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00 |................| 
000000e0 00 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 |................| 
* 
00000100 00 00 00 00 00 00 00 00 00 00 00 00 40 00 00 00 |............@...| 
00000110 00 00 00 00 00 00 00 00 00 00 01 1d 6d 64 69 61 |............mdia| 
00000120 00 00 00 20 6d 64 68 64 00 00 00 00 00 00 00 00 |... mdhd........| 
00000130 00 00 00 00 00 00 03 e8 00 00 00 00 39 84 00 00 |............9...| 
00000140 00 00 00 35 68 64 6c 72 00 00 00 00 00 00 00 00 |...5hdlr........| 
00000150 73 75 62 74 00 00 00 00 00 00 00 00 00 00 00 00 |subt............| 
00000160 55 53 50 20 53 75 62 74 69 74 6c 65 20 48 61 6e |USP Subtitle Han| 
00000170 64 6c 65 72 00 00 00 00 c0 6d 69 6e 66 00 00 00 |dler.....minf...| 
00000180 0c 73 74 68 64 00 00 00 00 00 00 00 24 64 69 6e |.sthd.......$din| 
00000190 66 00 00 00 1c 64 72 65 66 00 00 00 00 00 00 00 |f....dref.......| 
000001a0 01 00 00 00 0c 75 72 6c 20 00 00 00 01 00 00 00 |.....url .......| 
000001b0 88 73 74 62 6c 00 00 00 3c 73 74 73 64 00 00 00 |.stbl...<stsd...| 
000001c0 00 00 00 00 01 00 00 00 2c 73 74 70 70 00 00 00 |........,stpp...| 
000001d0 00 00 00 00 01 68 74 74 70 3a 2f 2f 77 77 77 2e |.....http://www.| 
000001e0 77 33 2e 6f 72 67 2f 6e 73 2f 74 74 6d 6c 00 00 |w3.org/ns/ttml..| 
000001f0 00 00 00 00 10 73 74 74 73 00 00 00 00 00 00 00 |.....stts.......| 
00000200 00 00 00 00 10 73 74 73 63 00 00 00 00 00 00 00 |.....stsc.......| 
00000210 00 00 00 00 14 73 74 73 7a 00 00 00 00 00 00 00 |.....stsz.......| 
00000220 00 00 00 00 00 00 00 00 10 73 74 63 6f 00 00 00 |.........stco...| 
00000230 00 00 00 00 00 00 00 00 28 6d 76 65 78 00 00 00 |........(mvex...| 
00000240 20 74 72 65 78 00 00 00 00 00 00 00 01 00 00 00 | trex...........| 
00000250 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 
00000260 18 73 74 79 70 69 73 6f 36 00 00 00 00 69 73 6f |.stypiso6....iso| 
00000270 36 6d 73 64 68 00 00 00 28 66 72 65 65 55 53 50 |6msdh...(freeUSP| 
00000280 20 62 79 20 43 6f 64 65 53 68 6f 70 11 11 11 11 | by CodeShop....| 
00000290 11 11 11 11 11 11 11 11 11 11 11 11 11 00 00 00 |................| 
000002a0 2c 73 69 64 78 00 00 00 00 00 00 00 01 00 00 03 |,sidx...........| 
000002b0 e8 00 00 00 00 00 00 00 00 00 00 00 01 00 00 0f |................| 
000002c0 09 00 00 ea 60 90 00 00 00 00 00 00 68 6d 6f 6f |....`.......hmoo| 
000002d0 66 00 00 00 10 6d 66 68 64 00 00 00 00 00 00 00 |f....mfhd.......| 
000002e0 01 00 00 00 50 74 72 61 66 00 00 00 14 74 66 68 |....Ptraf....tfh| 
000002f0 64 00 02 00 02 00 00 00 01 00 00 00 01 00 00 00 |d...............| 
00000300 14 74 66 64 74 01 00 00 00 00 00 00 00 00 00 00 |.tfdt...........| 
00000310 00 00 00 00 20 74 72 75 6e 00 00 07 01 00 00 00 |.... trun.......| 
00000320 01 00 00 00 70 00 00 ea 60 00 00 0e 99 02 80 00 |....p...`.......| 
00000330 40 00 00 0e a1 6d 64 61 74 3c 3f 78 6d 6c 20 76 |@....mdat<?xml v| 
00000340 65 72 73 69 6f 6e 3d 22 31 2e 30 22 20 65 6e 63 |ersion="1.0" enc| 
00000350 6f 64 69 6e 67 3d 22 75 74 66 2d 38 22 3f 3e 3c |oding="utf-8"?><| 
00000360 74 74 20 78 6d 6c 6e 73 3d 22 68 74 74 70 3a 2f |tt xmlns="http:/| 
00000370 2f 77 77 77 2e 77 33 2e 6f 72 67 2f 6e 73 2f 74 |/www.w3.org/ns/t| 
00000380 74 6d 6c 22 20 78 6d 6c 6e 73 3a 73 6d 70 74 65 |tml" xmlns:smpte| 
00000390 3d 22 68 74 74 70 3a 2f 2f 77 77 77 2e 73 6d 70 |="http://www.smp| 
000003a0 74 65 2d 72 61 2e 6f 72 67 2f 73 63 68 65 6d 61 |te-ra.org/schema| 
000003b0 73 2f 32 30 35 32 2d 31 2f 32 30 31 30 2f 73 6d |s/2052-1/2010/sm| 

J'ai honnêtement jamais vu quelque chose comme ça avant ...

Ainsi, la commande en cours d'exécution, je suis maintenant est la suivante:

ffmpeg -y -i 'audionld#24000.mp4' -i 'audionld#48000.mp4' -i 'textnld.mp4' -i 'video.mp4' -map 0:a -map 1:a -map 2:d -map 3:v -metadata:s:a:0 language=nld -metadata:s:a:1 language=nld -acodec copy -bsf:a aac_adtstoasc -vcodec copy -c:d copy -movflags faststart "test.mp4" 2>&1

qui résultats dans cette sortie:

ffmpeg version 3.2.5-1~bpo8+1 Copyright (c) 2000-2017 the FFmpeg developers 
    built with gcc 4.9.2 (Debian 4.9.2-10) 
    configuration: --prefix=/usr --extra-version='1~bpo8+1' --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --disable-libebur128 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared 
    libavutil  55. 34.101/55. 34.101 
    libavcodec  57. 64.101/57. 64.101 
    libavformat 57. 56.101/57. 56.101 
    libavdevice 57. 1.100/57. 1.100 
    libavfilter  6. 65.100/6. 65.100 
    libavresample 3. 1. 0/3. 1. 0 
    libswscale  4. 2.100/4. 2.100 
    libswresample 2. 3.100/2. 3.100 
    libpostproc 54. 1.100/54. 1.100 
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'audionld#24000.mp4': 
    Metadata: 
    major_brand  : iso6 
    minor_version : 0 
    compatible_brands: iso6dash 
    Duration: 00:03:06.07, start: 0.000000, bitrate: 64 kb/s 
    Stream #0:0(nld): Audio: aac (HE-AAC) (mp4a/0x6134706D), 48000 Hz, stereo, fltp, 62 kb/s (default) 
    Metadata: 
     handler_name : USP Sound Handler 
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'audionld#48000.mp4': 
    Metadata: 
    major_brand  : iso6 
    minor_version : 0 
    compatible_brands: iso6dash 
    Duration: 00:03:06.07, start: 0.000000, bitrate: 95 kb/s 
    Stream #1:0(nld): Audio: aac (LC) (mp4a/0x6134706D), 48000 Hz, stereo, fltp, 93 kb/s (default) 
    Metadata: 
     handler_name : USP Sound Handler 
Input #2, mov,mp4,m4a,3gp,3g2,mj2, from 'textnld.mp4': 
    Metadata: 
    major_brand  : iso6 
    minor_version : 0 
    compatible_brands: iso6dash 
    Duration: 00:03:05.76, bitrate: 0 kb/s 
    Stream #2:0(nld): Data: none (stpp/0x70707473), 0 kb/s (default) 
    Metadata: 
     handler_name : USP Subtitle Handler 
Input #3, mov,mp4,m4a,3gp,3g2,mj2, from 'video.mp4': 
    Metadata: 
    major_brand  : iso6 
    minor_version : 0 
    compatible_brands: iso6dash 
    Duration: 00:03:06.08, start: 0.000000, bitrate: 152 kb/s 
    Stream #3:0(und): Video: h264 (Constrained Baseline) (avc1/0x31637661), yuv420p, 416x234 [SAR 1:1 DAR 16:9], 144 kb/s, 25 fps, 25 tbr, 25k tbn, 50 tbc (default) 
    Metadata: 
     handler_name : USP Video Handler 
     encoder   : Elemental H.264 
[mp4 @ 0x7f15299c4520] Could not find tag for codec none in stream #2, codec not currently supported in container 
Could not write header for output file #0 (incorrect codec parameters ?): Invalid argumentStream mapping: 
    Stream #0:0 -> #0:0 (copy) 
    Stream #1:0 -> #0:1 (copy) 
    Stream #2:0 -> #0:2 (copy) 
    Stream #3:0 -> #0:3 (copy) 
    Last message repeated 1 times 

Cela donne l'erreur: Impossible de trouver le tag pour aucun codec dans le flux # 2, codec actuellement pas pris en charge dans le conteneur Impossible d'écrire en-tête pour le fichier de sortie # 0 (paramètres de codec incorrect?): Invalid argument

J'ai essayé de jouer avec la carte comme ceci:

-map 2: s ==> Me confie: La carte du flux '2: s' ne correspond à aucun flux. Pour ignorer cela, ajoutez un '?' Final à la carte.

-map 2: s? ==> Ne me donne pas d'erreur, mais le flux de sous-titres n'est pas ajouté dans le fichier final.

Stream mapping: 
    Stream #0:0 -> #0:0 (copy) 
    Stream #1:0 -> #0:1 (copy) 
    Stream #3:0 -> #0:2 (copy) 

Je dois d'abord peut-être convertir le sous-titre en srt ou tel, mais pour que je ne trouve pas sur google quel type de fichier il est.

Toute aide serait grandement appréciée!

Merci

--- EDIT ---

le code Par la présente j'utilise pour convertir cela en PHP:

private function convert_TTML_subtitle_file($orig) { 
    if ($orig == '' || !file_exists($orig)) { 
     return false; 
    } 

    $f = file_get_contents($orig); 
    $pos = stripos($f, '<tt xmlns="http://www.w3.org/ns/ttml"'); 
    if ($pos === false) { 
     return false; 
    } 

    $size = strlen($f); 
    $cur = 0; 
    $txt = ''; 
    $counter = 1; 
    while ($cur < $size) { 
#  var_dump("cur: $cur"); 
     $curSize = unpack('N', substr($f, $cur))[1]; 
#  var_dump("curSize: $curSize"); 
     if (substr($f, $cur+4, 4) == 'mdat') { 
     $xml = simplexml_load_string(substr($f, $cur+8, $curSize - 8)); 
     foreach($xml->body->div->p as $p) { 
      $txt .= "{$counter}\r\n"; 
      $counter++; 
      $txt .= $p['begin'] . ' --> ' . $p['end'] . "\r\n"; 
      $txt .= $p->span . "\r\n\r\n"; 
     } 
     } 
     $cur += $curSize; 
    } 

    $fname = tempnam(getcwd(), 'sub'); 
    file_put_contents($fname, $txt); 
    return $fname; 
    } 

Answer 1

On dirait que ce sont des sous-titres TTML. FFmpeg ne les a pas encore support.

Vous pouvez

ffmpeg -y -i 'audionld#24000.mp4' -i 'audionld#48000.mp4' -i 'textnld.mp4' -i 'video.mp4' 
     -map 0:a -map 1:a -map 2:d -map 3:v 
     -metadata:s:a:0 language=nld -metadata:s:a:1 language=nld 
     -c:a copy -bsf:a aac_adtstoasc -c:v copy -c:d copy -copy_unknown -dtag stpp 
     -strict -2 -movflags faststart "test.mp4" 2>&1 

Mais je voudrais essayer de mp4box au sein GPAC.