Archivo:
etl_20260501_073002.log
Modificado:
01/05/2026 07:30:08
Tamaño:
18.4 KB
Líneas:
223 líneas
2026-05-01 07:30:02,105 [INFO] Iniciando proceso ETL...
2026-05-01 07:30:02,105 [INFO] === INICIO ETL ===
2026-05-01 07:30:02,105 [INFO] Paso 0: Sincronización de IDs
2026-05-01 07:30:02,105 [INFO] Sincronizando tabla pedidos_id_mapping...
2026-05-01 07:30:02,105 [INFO] Intentando conectar a SQL Server...
2026-05-01 07:30:03,491 [INFO] Conexión SQL Server exitosa
2026-05-01 07:30:03,952 [INFO] Sincronización completada: 0 nuevos IDs asignados
2026-05-01 07:30:03,952 [INFO] Paso 1: Extracción de datos
2026-05-01 07:30:03,952 [INFO] Iniciando extracción de cabeceras
2026-05-01 07:30:03,952 [INFO] Extrayendo órdenes desde linux_ordenes...
2026-05-01 07:30:03,952 [INFO] Intentando conectar a SQL Server...
2026-05-01 07:30:04,843 [INFO] Conexión SQL Server exitosa
2026-05-01 07:30:04,843 [INFO] Ejecutando consulta (últimos 30 días desde 2026-04-01): SELECT numero, cliente, vendedor, fecha_entrega, dias_restantes, estatus FROM dbo.linux_ordenes WHERE fecha_entrega >= ?
2026-05-01 07:30:05,726 [INFO] Extraídas 178 órdenes
2026-05-01 07:30:05,726 [INFO] [DEBUG] Columnas ordenes: ['numero', 'cliente', 'vendedor', 'fecha_entrega', 'dias_restantes', 'estatus']
2026-05-01 07:30:05,727 [INFO] [DEBUG] dtypes ordenes: {'numero': dtype('O'), 'cliente': dtype('O'), 'vendedor': dtype('O'), 'fecha_entrega': dtype('O'), 'dias_restantes': dtype('int64'), 'estatus': dtype('O')}
2026-05-01 07:30:05,732 [INFO] [DEBUG] Nulos en fecha_entrega (ordenes) tras limpiar: 0
2026-05-01 07:30:05,880 [INFO] Iniciando extracción de líneas
2026-05-01 07:30:05,880 [INFO] Extrayendo pedidos desde linux_pedidos...
2026-05-01 07:30:05,880 [INFO] Intentando conectar a SQL Server...
2026-05-01 07:30:06,796 [INFO] Conexión SQL Server exitosa
2026-05-01 07:30:06,797 [INFO] Ejecutando consulta (últimos 30 días desde 2026-04-01): SELECT id, orden_id, clave, producto, unidad, cantidad, surtido, liq, saldo, fecha_entrega, remision FROM dbo.linux_pedidos WHERE fecha_entrega >= ?
2026-05-01 07:30:07,883 [INFO] Extraídos 497 pedidos
2026-05-01 07:30:07,884 [INFO] [DEBUG] Columnas pedidos: ['id', 'orden_id', 'clave', 'producto', 'unidad', 'cantidad', 'surtido', 'liq', 'saldo', 'fecha_entrega', 'remision']
2026-05-01 07:30:07,884 [INFO] [DEBUG] dtypes pedidos: {'id': dtype('O'), 'orden_id': dtype('float64'), 'clave': dtype('O'), 'producto': dtype('O'), 'unidad': dtype('O'), 'cantidad': dtype('int64'), 'surtido': dtype('int64'), 'liq': dtype('int64'), 'saldo': dtype('int64'), 'fecha_entrega': dtype('O'), 'remision': dtype('float64')}
2026-05-01 07:30:07,890 [INFO] [DEBUG] Nulos en fecha_entrega (pedidos) tras limpiar: 0
2026-05-01 07:30:08,051 [INFO] Extraídas 497 líneas
2026-05-01 07:30:08,051 [INFO] Extracción completada en 4.10s
2026-05-01 07:30:08,051 [INFO] Paso 2: Transformación de datos
2026-05-01 07:30:08,051 [INFO] Transformando datos de cabeceras
2026-05-01 07:30:08,052 [INFO] [DEBUG] Nulos por columna (cabeceras): {'numero': 0, 'cliente': 0, 'vendedor': 0, 'fecha_entrega': 0, 'dias_restantes': 0, 'estatus': 0}
2026-05-01 07:30:08,059 [INFO] Transformadas 178 cabeceras
2026-05-01 07:30:08,059 [INFO] [DEBUG] Ejemplo cabeceras transformadas (3): [{'id': '7696', 'numero': '7696', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 94, 'prioridad': 'PROGRAMADO'}, {'id': '7702', 'numero': '7702', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 94, 'prioridad': 'PROGRAMADO'}, {'id': '7703', 'numero': '7703', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 94, 'prioridad': 'PROGRAMADO'}]
2026-05-01 07:30:08,059 [INFO] Transformando datos de líneas
2026-05-01 07:30:08,060 [INFO] [DEBUG] Nulos por columna (lineas): {'id': 0, 'orden_id': 0, 'clave': 0, 'producto': 0, 'unidad': 0, 'cantidad': 0, 'surtido': 0, 'liq': 0, 'saldo': 0, 'fecha_entrega': 0, 'remision': 121}
2026-05-01 07:30:08,078 [INFO] Transformadas 497 líneas
2026-05-01 07:30:08,079 [INFO] [DEBUG] Ejemplo líneas transformadas (3): [{'id': '7746_122', 'ID_UNICO': '7746_122', 'orden_id': '7746.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 12500, 'surtido': 12500, 'liq': 12500, 'saldo': 0, 'fecha_entrega': '2026-08-03', 'remision': '5570.0', 'dias_restantes': 94, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7952_467', 'ID_UNICO': '7952_467', 'orden_id': '7952.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 87500, 'surtido': 36000, 'liq': 87500, 'saldo': 51500, 'fecha_entrega': '2026-08-03', 'remision': '5776.0', 'dias_restantes': 94, 'entregado': 0, 'estatus': 'pendiente', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7980_506', 'ID_UNICO': '7980_506', 'orden_id': '7980.0', 'clave': '8000004', 'producto': 'MASILLA SELLADORA 1003.1H', 'unidad': 'KG', 'cantidad': 357, 'surtido': 357, 'liq': 357, 'saldo': 0, 'fecha_entrega': '2026-04-27', 'remision': '5791.0', 'dias_restantes': -4, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}]
2026-05-01 07:30:08,079 [INFO] Transformación completada en 0.03s
2026-05-01 07:30:08,079 [INFO] Paso 3: Carga de datos
2026-05-01 07:30:08,159 [INFO] Skipped manually modified orden: 7718
2026-05-01 07:30:08,160 [INFO] Skipped manually modified orden: 7719
2026-05-01 07:30:08,160 [INFO] Skipped manually modified orden: 7720
2026-05-01 07:30:08,162 [INFO] Skipped manually modified orden: 7729
2026-05-01 07:30:08,164 [INFO] Skipped manually modified orden: 7751
2026-05-01 07:30:08,167 [INFO] Skipped manually modified orden: 7792
2026-05-01 07:30:08,171 [INFO] Skipped manually modified orden: 7823
2026-05-01 07:30:08,171 [INFO] Skipped manually modified orden: 7833
2026-05-01 07:30:08,172 [INFO] Skipped manually modified orden: 7835
2026-05-01 07:30:08,175 [INFO] Skipped manually modified orden: 7881
2026-05-01 07:30:08,177 [INFO] Skipped manually modified orden: 7899
2026-05-01 07:30:08,197 [INFO] Skipped manually modified orden: 8014
2026-05-01 07:30:08,207 [INFO] Skipped manually modified orden: 8039
2026-05-01 07:30:08,210 [INFO] Skipped manually modified orden: 8050
2026-05-01 07:30:08,213 [INFO] Skipped manually modified orden: 8058
2026-05-01 07:30:08,219 [INFO] Skipped manually modified orden: 8071
2026-05-01 07:30:08,221 [INFO] Skipped manually modified orden: 8076
2026-05-01 07:30:08,221 [INFO] Skipped manually modified orden: 8077
2026-05-01 07:30:08,221 [INFO] Skipped manually modified orden: 8078
2026-05-01 07:30:08,222 [INFO] Skipped manually modified orden: 8079
2026-05-01 07:30:08,222 [INFO] Skipped manually modified orden: 8080
2026-05-01 07:30:08,222 [INFO] Skipped manually modified orden: 8081
2026-05-01 07:30:08,222 [INFO] Skipped manually modified orden: 8082
2026-05-01 07:30:08,223 [INFO] Skipped manually modified orden: 8083
2026-05-01 07:30:08,223 [INFO] Skipped manually modified orden: 8084
2026-05-01 07:30:08,223 [INFO] Skipped manually modified orden: 8085
2026-05-01 07:30:08,224 [INFO] Skipped manually modified orden: 8086
2026-05-01 07:30:08,224 [INFO] Skipped manually modified orden: 8087
2026-05-01 07:30:08,224 [INFO] Skipped manually modified orden: 8088
2026-05-01 07:30:08,224 [INFO] Skipped manually modified orden: 8089
2026-05-01 07:30:08,225 [INFO] Skipped manually modified orden: 8090
2026-05-01 07:30:08,225 [INFO] Skipped manually modified orden: 8091
2026-05-01 07:30:08,226 [INFO] Skipped manually modified orden: 8094
2026-05-01 07:30:08,230 [INFO] Merge de órdenes completado: 0 insertadas, 145 actualizadas, 33 omitidas
2026-05-01 07:30:08,255 [INFO] Skipped manually modified pedido: 7980_506
2026-05-01 07:30:08,255 [INFO] Skipped manually modified pedido: 8073_699
2026-05-01 07:30:08,260 [INFO] Skipped manually modified pedido: 8082_708
2026-05-01 07:30:08,265 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,266 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,274 [INFO] Skipped manually modified pedido: 8078_704
2026-05-01 07:30:08,275 [INFO] Skipped manually modified pedido: 8094_721
2026-05-01 07:30:08,277 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,278 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,279 [INFO] Skipped manually modified pedido: 8051_641
2026-05-01 07:30:08,284 [INFO] Skipped manually modified pedido: 7898_363
2026-05-01 07:30:08,287 [INFO] Skipped manually modified pedido: 7980_507
2026-05-01 07:30:08,288 [INFO] Skipped manually modified pedido: 8039_608
2026-05-01 07:30:08,288 [INFO] Skipped manually modified pedido: 7807_215
2026-05-01 07:30:08,293 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,294 [INFO] Skipped manually modified pedido: 7896_358
2026-05-01 07:30:08,296 [INFO] Skipped manually modified pedido: 8051_641
2026-05-01 07:30:08,300 [INFO] Skipped manually modified pedido: 7808_217
2026-05-01 07:30:08,303 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,305 [INFO] Skipped manually modified pedido: 8090_717
2026-05-01 07:30:08,307 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,309 [INFO] Skipped manually modified pedido: 7838_267
2026-05-01 07:30:08,309 [INFO] Skipped manually modified pedido: 7980_509
2026-05-01 07:30:08,310 [INFO] Skipped manually modified pedido: 8051_639
2026-05-01 07:30:08,311 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,316 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,317 [INFO] Skipped manually modified pedido: 7808_217
2026-05-01 07:30:08,318 [INFO] Skipped manually modified pedido: 8051_641
2026-05-01 07:30:08,318 [INFO] Skipped manually modified pedido: 7980_510
2026-05-01 07:30:08,321 [INFO] Skipped manually modified pedido: 7980_507
2026-05-01 07:30:08,328 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,333 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,337 [INFO] Skipped manually modified pedido: 8051_639
2026-05-01 07:30:08,337 [INFO] Skipped manually modified pedido: 7808_217
2026-05-01 07:30:08,340 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,343 [INFO] Skipped manually modified pedido: 8066_697
2026-05-01 07:30:08,345 [INFO] Skipped manually modified pedido: 7807_215
2026-05-01 07:30:08,345 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,348 [INFO] Skipped manually modified pedido: 7801_208
2026-05-01 07:30:08,349 [INFO] Skipped manually modified pedido: 7980_506
2026-05-01 07:30:08,353 [INFO] Skipped manually modified pedido: 8071_696
2026-05-01 07:30:08,356 [INFO] Skipped manually modified pedido: 8051_639
2026-05-01 07:30:08,358 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,358 [INFO] Skipped manually modified pedido: 7980_506
2026-05-01 07:30:08,359 [INFO] Skipped manually modified pedido: 8039_607
2026-05-01 07:30:08,361 [INFO] Skipped manually modified pedido: 7898_364
2026-05-01 07:30:08,362 [INFO] Skipped manually modified pedido: 8058_672
2026-05-01 07:30:08,365 [INFO] Skipped manually modified pedido: 8051_654
2026-05-01 07:30:08,367 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,373 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,374 [INFO] Skipped manually modified pedido: 8051_655
2026-05-01 07:30:08,374 [INFO] Skipped manually modified pedido: 7838_266
2026-05-01 07:30:08,376 [INFO] Skipped manually modified pedido: 7807_215
2026-05-01 07:30:08,379 [INFO] Skipped manually modified pedido: 8076_702
2026-05-01 07:30:08,380 [INFO] Skipped manually modified pedido: 8051_654
2026-05-01 07:30:08,385 [INFO] Skipped manually modified pedido: 7838_267
2026-05-01 07:30:08,386 [INFO] Skipped manually modified pedido: 7980_507
2026-05-01 07:30:08,387 [INFO] Skipped manually modified pedido: 8077_703
2026-05-01 07:30:08,390 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,390 [INFO] Skipped manually modified pedido: 7899_365
2026-05-01 07:30:08,391 [INFO] Skipped manually modified pedido: 7980_507
2026-05-01 07:30:08,396 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,400 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,400 [INFO] Skipped manually modified pedido: 8068_693
2026-05-01 07:30:08,401 [INFO] Skipped manually modified pedido: 7838_267
2026-05-01 07:30:08,402 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,403 [INFO] Skipped manually modified pedido: 7980_506
2026-05-01 07:30:08,403 [INFO] Skipped manually modified pedido: 8080_706
2026-05-01 07:30:08,406 [INFO] Skipped manually modified pedido: 8051_655
2026-05-01 07:30:08,407 [INFO] Skipped manually modified pedido: 8039_606
2026-05-01 07:30:08,408 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,411 [INFO] Skipped manually modified pedido: 8084_710
2026-05-01 07:30:08,413 [INFO] Skipped manually modified pedido: 7703_39
2026-05-01 07:30:08,414 [INFO] Skipped manually modified pedido: 7838_267
2026-05-01 07:30:08,416 [INFO] Skipped manually modified pedido: 7838_266
2026-05-01 07:30:08,417 [INFO] Skipped manually modified pedido: 8051_654
2026-05-01 07:30:08,428 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,430 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,430 [INFO] Skipped manually modified pedido: 7899_365
2026-05-01 07:30:08,432 [INFO] Skipped manually modified pedido: 7985_519
2026-05-01 07:30:08,432 [INFO] Skipped manually modified pedido: 7749_125
2026-05-01 07:30:08,433 [INFO] Skipped manually modified pedido: 7864_297
2026-05-01 07:30:08,438 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,441 [INFO] Skipped manually modified pedido: 7980_506
2026-05-01 07:30:08,444 [INFO] Skipped manually modified pedido: 7896_358
2026-05-01 07:30:08,445 [INFO] Skipped manually modified pedido: 8051_656
2026-05-01 07:30:08,445 [INFO] Skipped manually modified pedido: 8081_707
2026-05-01 07:30:08,446 [INFO] Skipped manually modified pedido: 8051_656
2026-05-01 07:30:08,449 [INFO] Skipped manually modified pedido: 7980_510
2026-05-01 07:30:08,453 [INFO] Skipped manually modified pedido: 7749_125
2026-05-01 07:30:08,454 [INFO] Skipped manually modified pedido: 7980_510
2026-05-01 07:30:08,461 [INFO] Skipped manually modified pedido: 7899_365
2026-05-01 07:30:08,464 [INFO] Skipped manually modified pedido: 8086_713
2026-05-01 07:30:08,468 [INFO] Skipped manually modified pedido: 7763_151
2026-05-01 07:30:08,479 [INFO] Skipped manually modified pedido: 7801_208
2026-05-01 07:30:08,481 [INFO] Skipped manually modified pedido: 7808_217
2026-05-01 07:30:08,484 [INFO] Skipped manually modified pedido: 7899_365
2026-05-01 07:30:08,487 [INFO] Skipped manually modified pedido: 8083_709
2026-05-01 07:30:08,492 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,494 [INFO] Skipped manually modified pedido: 8051_655
2026-05-01 07:30:08,496 [INFO] Skipped manually modified pedido: 7980_509
2026-05-01 07:30:08,500 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,501 [INFO] Skipped manually modified pedido: 7980_507
2026-05-01 07:30:08,504 [INFO] Skipped manually modified pedido: 7763_151
2026-05-01 07:30:08,505 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,507 [INFO] Skipped manually modified pedido: 7896_358
2026-05-01 07:30:08,509 [INFO] Skipped manually modified pedido: 7980_509
2026-05-01 07:30:08,510 [INFO] Skipped manually modified pedido: 8094_722
2026-05-01 07:30:08,511 [INFO] Skipped manually modified pedido: 7749_125
2026-05-01 07:30:08,514 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,517 [INFO] Skipped manually modified pedido: 8088_715
2026-05-01 07:30:08,521 [INFO] Skipped manually modified pedido: 8051_653
2026-05-01 07:30:08,527 [INFO] Skipped manually modified pedido: 8087_714
2026-05-01 07:30:08,528 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,531 [INFO] Skipped manually modified pedido: 7801_208
2026-05-01 07:30:08,533 [INFO] Skipped manually modified pedido: 8058_673
2026-05-01 07:30:08,546 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,546 [INFO] Skipped manually modified pedido: 7985_519
2026-05-01 07:30:08,549 [INFO] Skipped manually modified pedido: 7980_509
2026-05-01 07:30:08,554 [INFO] Skipped manually modified pedido: 7808_217
2026-05-01 07:30:08,555 [INFO] Skipped manually modified pedido: 7980_510
2026-05-01 07:30:08,563 [INFO] Skipped manually modified pedido: 8089_716
2026-05-01 07:30:08,564 [INFO] Skipped manually modified pedido: 8051_653
2026-05-01 07:30:08,565 [INFO] Skipped manually modified pedido: 8079_705
2026-05-01 07:30:08,567 [INFO] Skipped manually modified pedido: 8051_653
2026-05-01 07:30:08,572 [INFO] Skipped manually modified pedido: 7801_206
2026-05-01 07:30:08,575 [INFO] Skipped manually modified pedido: 7979_505
2026-05-01 07:30:08,579 [INFO] Skipped manually modified pedido: 7864_297
2026-05-01 07:30:08,580 [INFO] Skipped manually modified pedido: 8091_718
2026-05-01 07:30:08,582 [INFO] Skipped manually modified pedido: 7896_358
2026-05-01 07:30:08,585 [INFO] Skipped manually modified pedido: 7980_509
2026-05-01 07:30:08,587 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,588 [INFO] Skipped manually modified pedido: 7898_363
2026-05-01 07:30:08,591 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,599 [INFO] Skipped manually modified pedido: 7703_39
2026-05-01 07:30:08,600 [INFO] Skipped manually modified pedido: 7980_510
2026-05-01 07:30:08,601 [INFO] Skipped manually modified pedido: 7823_245
2026-05-01 07:30:08,607 [INFO] Skipped manually modified pedido: 7823_243
2026-05-01 07:30:08,608 [INFO] Skipped manually modified pedido: 7838_266
2026-05-01 07:30:08,610 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,615 [INFO] Skipped manually modified pedido: 8095_725
2026-05-01 07:30:08,617 [INFO] Skipped manually modified pedido: 7985_519
2026-05-01 07:30:08,622 [INFO] Skipped manually modified pedido: 7823_246
2026-05-01 07:30:08,627 [INFO] Skipped manually modified pedido: 7808_217
2026-05-01 07:30:08,631 [INFO] Merge de pedidos completado: 0 insertados, 353 actualizados, 144 omitidos
2026-05-01 07:30:08,631 [INFO] Carga completada en 0.55s
2026-05-01 07:30:08,631 [INFO] [SUCCESS] ETL completado sin errores
2026-05-01 07:30:08,631 [INFO] === PROCESO ETL COMPLETADO EXITOSAMENTE ===
2026-05-01 07:30:08,631 [INFO] Resumen: órdenes 0, pedidos 0
Tip: Usa Ctrl+F para buscar texto específico en el log