Archivo:
etl_20260429_090001.log
Modificado:
29/04/2026 09:00:32
Tamaño:
16.8 KB
Líneas:
199 líneas
2026-04-29 09:00:01,687 [INFO] Iniciando proceso ETL...
2026-04-29 09:00:01,688 [INFO] === INICIO ETL ===
2026-04-29 09:00:01,688 [INFO] Paso 0: Sincronización de IDs
2026-04-29 09:00:01,688 [INFO] Sincronizando tabla pedidos_id_mapping...
2026-04-29 09:00:01,688 [INFO] Intentando conectar a SQL Server...
2026-04-29 09:00:28,256 [INFO] Conexión SQL Server exitosa
2026-04-29 09:00:28,256 [ERROR] Error al sincronizar IDs: ('08S01', '[08S01] [Microsoft][ODBC Driver 18 for SQL Server]Communication link failure (0) (SQLExecDirectW)')
2026-04-29 09:00:28,256 [INFO] Paso 1: Extracción de datos
2026-04-29 09:00:28,256 [INFO] Iniciando extracción de cabeceras
2026-04-29 09:00:28,256 [INFO] Extrayendo órdenes desde linux_ordenes...
2026-04-29 09:00:28,256 [INFO] Intentando conectar a SQL Server...
2026-04-29 09:00:28,923 [INFO] Conexión SQL Server exitosa
2026-04-29 09:00:28,923 [INFO] Ejecutando consulta (últimos 30 días desde 2026-03-30): SELECT numero, cliente, vendedor, fecha_entrega, dias_restantes, estatus FROM dbo.linux_ordenes WHERE fecha_entrega >= ?
2026-04-29 09:00:29,618 [INFO] Extraídas 174 órdenes
2026-04-29 09:00:29,618 [INFO] [DEBUG] Columnas ordenes: ['numero', 'cliente', 'vendedor', 'fecha_entrega', 'dias_restantes', 'estatus']
2026-04-29 09:00:29,618 [INFO] [DEBUG] dtypes ordenes: {'numero': dtype('O'), 'cliente': dtype('O'), 'vendedor': dtype('O'), 'fecha_entrega': dtype('O'), 'dias_restantes': dtype('int64'), 'estatus': dtype('O')}
2026-04-29 09:00:29,624 [INFO] [DEBUG] Nulos en fecha_entrega (ordenes) tras limpiar: 0
2026-04-29 09:00:29,721 [INFO] Iniciando extracción de líneas
2026-04-29 09:00:29,721 [INFO] Extrayendo pedidos desde linux_pedidos...
2026-04-29 09:00:29,721 [INFO] Intentando conectar a SQL Server...
2026-04-29 09:00:30,306 [INFO] Conexión SQL Server exitosa
2026-04-29 09:00:30,306 [INFO] Ejecutando consulta (últimos 30 días desde 2026-03-30): SELECT id, orden_id, clave, producto, unidad, cantidad, surtido, liq, saldo, fecha_entrega, remision FROM dbo.linux_pedidos WHERE fecha_entrega >= ?
2026-04-29 09:00:31,156 [INFO] Extraídos 495 pedidos
2026-04-29 09:00:31,156 [INFO] [DEBUG] Columnas pedidos: ['id', 'orden_id', 'clave', 'producto', 'unidad', 'cantidad', 'surtido', 'liq', 'saldo', 'fecha_entrega', 'remision']
2026-04-29 09:00:31,156 [INFO] [DEBUG] dtypes pedidos: {'id': dtype('O'), 'orden_id': dtype('float64'), 'clave': dtype('O'), 'producto': dtype('O'), 'unidad': dtype('O'), 'cantidad': dtype('int64'), 'surtido': dtype('int64'), 'liq': dtype('int64'), 'saldo': dtype('int64'), 'fecha_entrega': dtype('O'), 'remision': dtype('float64')}
2026-04-29 09:00:31,163 [INFO] [DEBUG] Nulos en fecha_entrega (pedidos) tras limpiar: 0
2026-04-29 09:00:31,363 [INFO] Extraídas 495 líneas
2026-04-29 09:00:31,363 [INFO] Extracción completada en 3.11s
2026-04-29 09:00:31,363 [INFO] Paso 2: Transformación de datos
2026-04-29 09:00:31,363 [INFO] Transformando datos de cabeceras
2026-04-29 09:00:31,364 [INFO] [DEBUG] Nulos por columna (cabeceras): {'numero': 0, 'cliente': 0, 'vendedor': 0, 'fecha_entrega': 0, 'dias_restantes': 0, 'estatus': 0}
2026-04-29 09:00:31,370 [INFO] Transformadas 174 cabeceras
2026-04-29 09:00:31,371 [INFO] [DEBUG] Ejemplo cabeceras transformadas (3): [{'id': '7696', 'numero': '7696', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 96, 'prioridad': 'PROGRAMADO'}, {'id': '7702', 'numero': '7702', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 96, 'prioridad': 'PROGRAMADO'}, {'id': '7703', 'numero': '7703', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 96, 'prioridad': 'PROGRAMADO'}]
2026-04-29 09:00:31,371 [INFO] Transformando datos de líneas
2026-04-29 09:00:31,371 [INFO] [DEBUG] Nulos por columna (lineas): {'id': 0, 'orden_id': 0, 'clave': 0, 'producto': 0, 'unidad': 0, 'cantidad': 0, 'surtido': 0, 'liq': 0, 'saldo': 0, 'fecha_entrega': 0, 'remision': 119}
2026-04-29 09:00:31,390 [INFO] Transformadas 495 líneas
2026-04-29 09:00:31,391 [INFO] [DEBUG] Ejemplo líneas transformadas (3): [{'id': '7746_122', 'ID_UNICO': '7746_122', 'orden_id': '7746.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 12500, 'surtido': 12500, 'liq': 12500, 'saldo': 0, 'fecha_entrega': '2026-08-03', 'remision': '5570.0', 'dias_restantes': 96, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7952_467', 'ID_UNICO': '7952_467', 'orden_id': '7952.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 87500, 'surtido': 36000, 'liq': 87500, 'saldo': 51500, 'fecha_entrega': '2026-08-03', 'remision': '5776.0', 'dias_restantes': 96, 'entregado': 0, 'estatus': 'pendiente', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7980_506', 'ID_UNICO': '7980_506', 'orden_id': '7980.0', 'clave': '8000004', 'producto': 'MASILLA SELLADORA 1003.1H', 'unidad': 'KG', 'cantidad': 357, 'surtido': 357, 'liq': 357, 'saldo': 0, 'fecha_entrega': '2026-04-27', 'remision': '5791.0', 'dias_restantes': -2, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}]
2026-04-29 09:00:31,391 [INFO] Transformación completada en 0.03s
2026-04-29 09:00:31,391 [INFO] Paso 3: Carga de datos
2026-04-29 09:00:31,556 [INFO] Skipped manually modified orden: 7718
2026-04-29 09:00:31,557 [INFO] Skipped manually modified orden: 7719
2026-04-29 09:00:31,557 [INFO] Skipped manually modified orden: 7720
2026-04-29 09:00:31,559 [INFO] Skipped manually modified orden: 7729
2026-04-29 09:00:31,561 [INFO] Skipped manually modified orden: 7751
2026-04-29 09:00:31,565 [INFO] Skipped manually modified orden: 7792
2026-04-29 09:00:31,569 [INFO] Skipped manually modified orden: 7823
2026-04-29 09:00:31,569 [INFO] Skipped manually modified orden: 7833
2026-04-29 09:00:31,570 [INFO] Skipped manually modified orden: 7835
2026-04-29 09:00:31,575 [INFO] Skipped manually modified orden: 7881
2026-04-29 09:00:31,576 [INFO] Skipped manually modified orden: 7899
2026-04-29 09:00:31,598 [INFO] Skipped manually modified orden: 8014
2026-04-29 09:00:31,607 [INFO] Skipped manually modified orden: 8039
2026-04-29 09:00:31,610 [INFO] Skipped manually modified orden: 8050
2026-04-29 09:00:31,617 [INFO] Skipped manually modified orden: 8071
2026-04-29 09:00:31,619 [INFO] Skipped manually modified orden: 8076
2026-04-29 09:00:31,620 [INFO] Skipped manually modified orden: 8078
2026-04-29 09:00:31,620 [INFO] Skipped manually modified orden: 8079
2026-04-29 09:00:31,620 [INFO] Skipped manually modified orden: 8080
2026-04-29 09:00:31,621 [INFO] Skipped manually modified orden: 8081
2026-04-29 09:00:31,621 [INFO] Skipped manually modified orden: 8082
2026-04-29 09:00:31,621 [INFO] Skipped manually modified orden: 8083
2026-04-29 09:00:31,622 [INFO] Skipped manually modified orden: 8084
2026-04-29 09:00:31,622 [INFO] Skipped manually modified orden: 8085
2026-04-29 09:00:31,623 [INFO] Skipped manually modified orden: 8088
2026-04-29 09:00:31,625 [INFO] Merge de órdenes completado: 0 insertadas, 149 actualizadas, 25 omitidas
2026-04-29 09:00:31,649 [INFO] Skipped manually modified pedido: 7980_506
2026-04-29 09:00:31,650 [INFO] Skipped manually modified pedido: 8073_699
2026-04-29 09:00:31,654 [INFO] Skipped manually modified pedido: 8051_639
2026-04-29 09:00:31,656 [INFO] Skipped manually modified pedido: 8082_708
2026-04-29 09:00:31,660 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,661 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,669 [INFO] Skipped manually modified pedido: 8078_704
2026-04-29 09:00:31,672 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:31,673 [INFO] Skipped manually modified pedido: 7871_314
2026-04-29 09:00:31,674 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,675 [INFO] Skipped manually modified pedido: 8051_641
2026-04-29 09:00:31,679 [INFO] Skipped manually modified pedido: 7871_314
2026-04-29 09:00:31,680 [INFO] Skipped manually modified pedido: 7898_363
2026-04-29 09:00:31,683 [INFO] Skipped manually modified pedido: 7980_507
2026-04-29 09:00:31,684 [INFO] Skipped manually modified pedido: 7807_215
2026-04-29 09:00:31,684 [INFO] Skipped manually modified pedido: 7871_314
2026-04-29 09:00:31,690 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,691 [INFO] Skipped manually modified pedido: 7896_358
2026-04-29 09:00:31,696 [INFO] Skipped manually modified pedido: 7808_217
2026-04-29 09:00:31,699 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,703 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,705 [INFO] Skipped manually modified pedido: 7838_267
2026-04-29 09:00:31,706 [INFO] Skipped manually modified pedido: 7980_509
2026-04-29 09:00:31,709 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,713 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,713 [INFO] Skipped manually modified pedido: 7808_217
2026-04-29 09:00:31,715 [INFO] Skipped manually modified pedido: 8051_641
2026-04-29 09:00:31,715 [INFO] Skipped manually modified pedido: 7980_510
2026-04-29 09:00:31,718 [INFO] Skipped manually modified pedido: 7980_507
2026-04-29 09:00:31,726 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,730 [INFO] Skipped manually modified pedido: 8051_639
2026-04-29 09:00:31,731 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:31,734 [INFO] Skipped manually modified pedido: 7808_217
2026-04-29 09:00:31,737 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,740 [INFO] Skipped manually modified pedido: 8066_697
2026-04-29 09:00:31,742 [INFO] Skipped manually modified pedido: 7807_215
2026-04-29 09:00:31,744 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,747 [INFO] Skipped manually modified pedido: 7801_208
2026-04-29 09:00:31,748 [INFO] Skipped manually modified pedido: 7980_506
2026-04-29 09:00:31,754 [INFO] Skipped manually modified pedido: 8071_696
2026-04-29 09:00:31,759 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,759 [INFO] Skipped manually modified pedido: 7980_506
2026-04-29 09:00:31,762 [INFO] Skipped manually modified pedido: 7898_364
2026-04-29 09:00:31,769 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,777 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,778 [INFO] Skipped manually modified pedido: 8051_655
2026-04-29 09:00:31,778 [INFO] Skipped manually modified pedido: 7838_266
2026-04-29 09:00:31,780 [INFO] Skipped manually modified pedido: 7807_215
2026-04-29 09:00:31,784 [INFO] Skipped manually modified pedido: 8076_702
2026-04-29 09:00:31,786 [INFO] Skipped manually modified pedido: 8051_654
2026-04-29 09:00:31,793 [INFO] Skipped manually modified pedido: 7838_267
2026-04-29 09:00:31,793 [INFO] Skipped manually modified pedido: 7980_507
2026-04-29 09:00:31,801 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,802 [INFO] Skipped manually modified pedido: 7899_365
2026-04-29 09:00:31,802 [INFO] Skipped manually modified pedido: 7980_507
2026-04-29 09:00:31,808 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:31,812 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:31,813 [INFO] Skipped manually modified pedido: 8068_693
2026-04-29 09:00:31,813 [INFO] Skipped manually modified pedido: 7838_267
2026-04-29 09:00:31,816 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,817 [INFO] Skipped manually modified pedido: 7980_506
2026-04-29 09:00:31,818 [INFO] Skipped manually modified pedido: 8080_706
2026-04-29 09:00:31,821 [INFO] Skipped manually modified pedido: 8051_655
2026-04-29 09:00:31,823 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,827 [INFO] Skipped manually modified pedido: 8084_710
2026-04-29 09:00:31,829 [INFO] Skipped manually modified pedido: 7703_39
2026-04-29 09:00:31,830 [INFO] Skipped manually modified pedido: 7838_267
2026-04-29 09:00:31,832 [INFO] Skipped manually modified pedido: 7838_266
2026-04-29 09:00:31,834 [INFO] Skipped manually modified pedido: 8051_654
2026-04-29 09:00:31,847 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,848 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,849 [INFO] Skipped manually modified pedido: 7899_365
2026-04-29 09:00:31,850 [INFO] Skipped manually modified pedido: 7985_519
2026-04-29 09:00:31,851 [INFO] Skipped manually modified pedido: 7749_125
2026-04-29 09:00:31,851 [INFO] Skipped manually modified pedido: 7864_297
2026-04-29 09:00:31,858 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:31,861 [INFO] Skipped manually modified pedido: 7980_506
2026-04-29 09:00:31,864 [INFO] Skipped manually modified pedido: 7896_358
2026-04-29 09:00:31,866 [INFO] Skipped manually modified pedido: 8081_707
2026-04-29 09:00:31,868 [INFO] Skipped manually modified pedido: 7980_510
2026-04-29 09:00:31,871 [INFO] Skipped manually modified pedido: 7749_125
2026-04-29 09:00:31,873 [INFO] Skipped manually modified pedido: 7980_510
2026-04-29 09:00:31,881 [INFO] Skipped manually modified pedido: 7899_365
2026-04-29 09:00:31,889 [INFO] Skipped manually modified pedido: 7763_151
2026-04-29 09:00:31,900 [INFO] Skipped manually modified pedido: 7801_208
2026-04-29 09:00:31,903 [INFO] Skipped manually modified pedido: 7808_217
2026-04-29 09:00:31,908 [INFO] Skipped manually modified pedido: 7899_365
2026-04-29 09:00:31,912 [INFO] Skipped manually modified pedido: 8083_709
2026-04-29 09:00:31,917 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:31,922 [INFO] Skipped manually modified pedido: 7980_509
2026-04-29 09:00:31,927 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:31,928 [INFO] Skipped manually modified pedido: 7980_507
2026-04-29 09:00:31,934 [INFO] Skipped manually modified pedido: 7763_151
2026-04-29 09:00:31,935 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:31,938 [INFO] Skipped manually modified pedido: 7896_358
2026-04-29 09:00:31,940 [INFO] Skipped manually modified pedido: 7980_509
2026-04-29 09:00:31,942 [INFO] Skipped manually modified pedido: 7749_125
2026-04-29 09:00:31,946 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:31,948 [INFO] Skipped manually modified pedido: 8088_715
2026-04-29 09:00:31,959 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:31,960 [INFO] Skipped manually modified pedido: 7871_314
2026-04-29 09:00:31,963 [INFO] Skipped manually modified pedido: 7801_208
2026-04-29 09:00:31,983 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:31,984 [INFO] Skipped manually modified pedido: 7985_519
2026-04-29 09:00:31,987 [INFO] Skipped manually modified pedido: 7980_509
2026-04-29 09:00:31,992 [INFO] Skipped manually modified pedido: 7808_217
2026-04-29 09:00:31,993 [INFO] Skipped manually modified pedido: 7980_510
2026-04-29 09:00:32,001 [INFO] Skipped manually modified pedido: 8051_653
2026-04-29 09:00:32,001 [INFO] Skipped manually modified pedido: 8079_705
2026-04-29 09:00:32,004 [INFO] Skipped manually modified pedido: 7871_314
2026-04-29 09:00:32,004 [INFO] Skipped manually modified pedido: 8051_653
2026-04-29 09:00:32,009 [INFO] Skipped manually modified pedido: 7801_206
2026-04-29 09:00:32,012 [INFO] Skipped manually modified pedido: 7979_505
2026-04-29 09:00:32,016 [INFO] Skipped manually modified pedido: 7864_297
2026-04-29 09:00:32,020 [INFO] Skipped manually modified pedido: 7896_358
2026-04-29 09:00:32,024 [INFO] Skipped manually modified pedido: 7980_509
2026-04-29 09:00:32,025 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:32,027 [INFO] Skipped manually modified pedido: 7898_363
2026-04-29 09:00:32,031 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:32,038 [INFO] Skipped manually modified pedido: 7703_39
2026-04-29 09:00:32,039 [INFO] Skipped manually modified pedido: 7980_510
2026-04-29 09:00:32,041 [INFO] Skipped manually modified pedido: 7823_245
2026-04-29 09:00:32,047 [INFO] Skipped manually modified pedido: 7823_243
2026-04-29 09:00:32,048 [INFO] Skipped manually modified pedido: 7838_266
2026-04-29 09:00:32,050 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:32,059 [INFO] Skipped manually modified pedido: 7985_519
2026-04-29 09:00:32,063 [INFO] Skipped manually modified pedido: 7823_246
2026-04-29 09:00:32,069 [INFO] Skipped manually modified pedido: 7808_217
2026-04-29 09:00:32,074 [INFO] Merge de pedidos completado: 0 insertados, 367 actualizados, 128 omitidos
2026-04-29 09:00:32,074 [INFO] Carga completada en 0.68s
2026-04-29 09:00:32,074 [INFO] [SUCCESS] ETL completado sin errores
2026-04-29 09:00:32,074 [INFO] === PROCESO ETL COMPLETADO EXITOSAMENTE ===
2026-04-29 09:00:32,074 [INFO] Resumen: órdenes 0, pedidos 0
Tip: Usa Ctrl+F para buscar texto específico en el log