Archivo:
etl_20260427_173001.log
Modificado:
27/04/2026 17:30:07
Tamaño:
15.1 KB
Líneas:
176 líneas
2026-04-27 17:30:01,519 [INFO] Iniciando proceso ETL...
2026-04-27 17:30:01,519 [INFO] === INICIO ETL ===
2026-04-27 17:30:01,519 [INFO] Paso 0: Sincronización de IDs
2026-04-27 17:30:01,519 [INFO] Sincronizando tabla pedidos_id_mapping...
2026-04-27 17:30:01,519 [INFO] Intentando conectar a SQL Server...
2026-04-27 17:30:02,969 [INFO] Conexión SQL Server exitosa
2026-04-27 17:30:03,841 [INFO] Sincronización completada: 1 nuevos IDs asignados
2026-04-27 17:30:03,841 [INFO] Paso 1: Extracción de datos
2026-04-27 17:30:03,841 [INFO] Iniciando extracción de cabeceras
2026-04-27 17:30:03,841 [INFO] Extrayendo órdenes desde linux_ordenes...
2026-04-27 17:30:03,841 [INFO] Intentando conectar a SQL Server...
2026-04-27 17:30:04,423 [INFO] Conexión SQL Server exitosa
2026-04-27 17:30:04,423 [INFO] Ejecutando consulta (últimos 30 días desde 2026-03-28): SELECT numero, cliente, vendedor, fecha_entrega, dias_restantes, estatus FROM dbo.linux_ordenes WHERE fecha_entrega >= ?
2026-04-27 17:30:04,973 [INFO] Extraídas 168 órdenes
2026-04-27 17:30:04,973 [INFO] [DEBUG] Columnas ordenes: ['numero', 'cliente', 'vendedor', 'fecha_entrega', 'dias_restantes', 'estatus']
2026-04-27 17:30:04,973 [INFO] [DEBUG] dtypes ordenes: {'numero': dtype('O'), 'cliente': dtype('O'), 'vendedor': dtype('O'), 'fecha_entrega': dtype('O'), 'dias_restantes': dtype('int64'), 'estatus': dtype('O')}
2026-04-27 17:30:04,980 [INFO] [DEBUG] Nulos en fecha_entrega (ordenes) tras limpiar: 0
2026-04-27 17:30:05,076 [INFO] Iniciando extracción de líneas
2026-04-27 17:30:05,076 [INFO] Extrayendo pedidos desde linux_pedidos...
2026-04-27 17:30:05,076 [INFO] Intentando conectar a SQL Server...
2026-04-27 17:30:05,657 [INFO] Conexión SQL Server exitosa
2026-04-27 17:30:05,657 [INFO] Ejecutando consulta (últimos 30 días desde 2026-03-28): SELECT id, orden_id, clave, producto, unidad, cantidad, surtido, liq, saldo, fecha_entrega, remision FROM dbo.linux_pedidos WHERE fecha_entrega >= ?
2026-04-27 17:30:06,482 [INFO] Extraídos 482 pedidos
2026-04-27 17:30:06,482 [INFO] [DEBUG] Columnas pedidos: ['id', 'orden_id', 'clave', 'producto', 'unidad', 'cantidad', 'surtido', 'liq', 'saldo', 'fecha_entrega', 'remision']
2026-04-27 17:30:06,482 [INFO] [DEBUG] dtypes pedidos: {'id': dtype('O'), 'orden_id': dtype('float64'), 'clave': dtype('O'), 'producto': dtype('O'), 'unidad': dtype('O'), 'cantidad': dtype('int64'), 'surtido': dtype('int64'), 'liq': dtype('int64'), 'saldo': dtype('int64'), 'fecha_entrega': dtype('O'), 'remision': dtype('float64')}
2026-04-27 17:30:06,491 [INFO] [DEBUG] Nulos en fecha_entrega (pedidos) tras limpiar: 0
2026-04-27 17:30:06,724 [INFO] Extraídas 482 líneas
2026-04-27 17:30:06,724 [INFO] Extracción completada en 2.88s
2026-04-27 17:30:06,724 [INFO] Paso 2: Transformación de datos
2026-04-27 17:30:06,724 [INFO] Transformando datos de cabeceras
2026-04-27 17:30:06,725 [INFO] [DEBUG] Nulos por columna (cabeceras): {'numero': 0, 'cliente': 0, 'vendedor': 0, 'fecha_entrega': 0, 'dias_restantes': 0, 'estatus': 0}
2026-04-27 17:30:06,733 [INFO] Transformadas 168 cabeceras
2026-04-27 17:30:06,734 [INFO] [DEBUG] Ejemplo cabeceras transformadas (3): [{'id': '7696', 'numero': '7696', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 98, 'prioridad': 'PROGRAMADO'}, {'id': '7702', 'numero': '7702', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 98, 'prioridad': 'PROGRAMADO'}, {'id': '7703', 'numero': '7703', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 98, 'prioridad': 'PROGRAMADO'}]
2026-04-27 17:30:06,734 [INFO] Transformando datos de líneas
2026-04-27 17:30:06,734 [INFO] [DEBUG] Nulos por columna (lineas): {'id': 0, 'orden_id': 0, 'clave': 0, 'producto': 0, 'unidad': 0, 'cantidad': 0, 'surtido': 0, 'liq': 0, 'saldo': 0, 'fecha_entrega': 0, 'remision': 118}
2026-04-27 17:30:06,753 [INFO] Transformadas 482 líneas
2026-04-27 17:30:06,754 [INFO] [DEBUG] Ejemplo líneas transformadas (3): [{'id': '7746_122', 'ID_UNICO': '7746_122', 'orden_id': '7746.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 12500, 'surtido': 12500, 'liq': 12500, 'saldo': 0, 'fecha_entrega': '2026-08-03', 'remision': '5570.0', 'dias_restantes': 98, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7952_467', 'ID_UNICO': '7952_467', 'orden_id': '7952.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 87500, 'surtido': 36000, 'liq': 87500, 'saldo': 51500, 'fecha_entrega': '2026-08-03', 'remision': '5776.0', 'dias_restantes': 98, 'entregado': 0, 'estatus': 'pendiente', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7980_506', 'ID_UNICO': '7980_506', 'orden_id': '7980.0', 'clave': '8000004', 'producto': 'MASILLA SELLADORA 1003.1H', 'unidad': 'KG', 'cantidad': 357, 'surtido': 357, 'liq': 357, 'saldo': 0, 'fecha_entrega': '2026-04-27', 'remision': '5791.0', 'dias_restantes': 0, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}]
2026-04-27 17:30:06,754 [INFO] Transformación completada en 0.03s
2026-04-27 17:30:06,754 [INFO] Paso 3: Carga de datos
2026-04-27 17:30:06,847 [INFO] Skipped manually modified orden: 7718
2026-04-27 17:30:06,848 [INFO] Skipped manually modified orden: 7719
2026-04-27 17:30:06,848 [INFO] Skipped manually modified orden: 7720
2026-04-27 17:30:06,850 [INFO] Skipped manually modified orden: 7729
2026-04-27 17:30:06,852 [INFO] Skipped manually modified orden: 7751
2026-04-27 17:30:06,855 [INFO] Skipped manually modified orden: 7792
2026-04-27 17:30:06,859 [INFO] Skipped manually modified orden: 7823
2026-04-27 17:30:06,859 [INFO] Skipped manually modified orden: 7833
2026-04-27 17:30:06,860 [INFO] Skipped manually modified orden: 7835
2026-04-27 17:30:06,864 [INFO] Skipped manually modified orden: 7881
2026-04-27 17:30:06,865 [INFO] Skipped manually modified orden: 7899
2026-04-27 17:30:06,884 [INFO] Skipped manually modified orden: 8014
2026-04-27 17:30:06,896 [INFO] Skipped manually modified orden: 8050
2026-04-27 17:30:06,903 [INFO] Skipped manually modified orden: 8071
2026-04-27 17:30:06,906 [INFO] Skipped manually modified orden: 8076
2026-04-27 17:30:06,906 [INFO] Skipped manually modified orden: 8078
2026-04-27 17:30:06,907 [INFO] Skipped manually modified orden: 8079
2026-04-27 17:30:06,907 [INFO] Skipped manually modified orden: 8080
2026-04-27 17:30:06,907 [INFO] Skipped manually modified orden: 8081
2026-04-27 17:30:06,907 [INFO] Skipped manually modified orden: 8082
2026-04-27 17:30:06,909 [INFO] Merge de órdenes completado: 1 insertadas, 147 actualizadas, 20 omitidas
2026-04-27 17:30:06,931 [INFO] Skipped manually modified pedido: 7980_506
2026-04-27 17:30:06,933 [INFO] Skipped manually modified pedido: 8073_699
2026-04-27 17:30:06,937 [INFO] Skipped manually modified pedido: 8082_708
2026-04-27 17:30:06,940 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:06,941 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:06,945 [INFO] Skipped manually modified pedido: 7899_365
2026-04-27 17:30:06,950 [INFO] Skipped manually modified pedido: 8078_704
2026-04-27 17:30:06,953 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:06,954 [INFO] Skipped manually modified pedido: 7871_314
2026-04-27 17:30:06,954 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:06,957 [INFO] Skipped manually modified pedido: 7899_365
2026-04-27 17:30:06,961 [INFO] Skipped manually modified pedido: 7871_314
2026-04-27 17:30:06,962 [INFO] Skipped manually modified pedido: 7898_363
2026-04-27 17:30:06,965 [INFO] Skipped manually modified pedido: 7807_215
2026-04-27 17:30:06,966 [INFO] Skipped manually modified pedido: 7871_314
2026-04-27 17:30:06,974 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:06,975 [INFO] Skipped manually modified pedido: 7896_358
2026-04-27 17:30:06,980 [INFO] Skipped manually modified pedido: 7808_217
2026-04-27 17:30:06,983 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:06,988 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:06,990 [INFO] Skipped manually modified pedido: 7838_267
2026-04-27 17:30:06,994 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:06,998 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:06,999 [INFO] Skipped manually modified pedido: 7808_217
2026-04-27 17:30:07,000 [INFO] Skipped manually modified pedido: 7980_507
2026-04-27 17:30:07,007 [INFO] Skipped manually modified pedido: 7980_509
2026-04-27 17:30:07,012 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:07,017 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,021 [INFO] Skipped manually modified pedido: 7808_217
2026-04-27 17:30:07,023 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:07,026 [INFO] Skipped manually modified pedido: 8066_697
2026-04-27 17:30:07,028 [INFO] Skipped manually modified pedido: 7807_215
2026-04-27 17:30:07,030 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:07,033 [INFO] Skipped manually modified pedido: 8051_639
2026-04-27 17:30:07,034 [INFO] Skipped manually modified pedido: 7801_208
2026-04-27 17:30:07,040 [INFO] Skipped manually modified pedido: 8071_696
2026-04-27 17:30:07,045 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:07,046 [INFO] Skipped manually modified pedido: 7980_506
2026-04-27 17:30:07,049 [INFO] Skipped manually modified pedido: 7898_364
2026-04-27 17:30:07,055 [INFO] Skipped manually modified pedido: 7980_507
2026-04-27 17:30:07,057 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:07,066 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:07,067 [INFO] Skipped manually modified pedido: 7899_365
2026-04-27 17:30:07,067 [INFO] Skipped manually modified pedido: 7838_266
2026-04-27 17:30:07,069 [INFO] Skipped manually modified pedido: 7807_215
2026-04-27 17:30:07,073 [INFO] Skipped manually modified pedido: 8076_702
2026-04-27 17:30:07,078 [INFO] Skipped manually modified pedido: 7980_507
2026-04-27 17:30:07,082 [INFO] Skipped manually modified pedido: 7838_267
2026-04-27 17:30:07,087 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:07,094 [INFO] Skipped manually modified pedido: 8051_639
2026-04-27 17:30:07,095 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,100 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,100 [INFO] Skipped manually modified pedido: 8068_693
2026-04-27 17:30:07,101 [INFO] Skipped manually modified pedido: 7838_267
2026-04-27 17:30:07,104 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:07,106 [INFO] Skipped manually modified pedido: 7980_506
2026-04-27 17:30:07,106 [INFO] Skipped manually modified pedido: 8080_706
2026-04-27 17:30:07,111 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:07,117 [INFO] Skipped manually modified pedido: 7703_39
2026-04-27 17:30:07,118 [INFO] Skipped manually modified pedido: 7838_267
2026-04-27 17:30:07,121 [INFO] Skipped manually modified pedido: 7838_266
2026-04-27 17:30:07,135 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:07,137 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:07,139 [INFO] Skipped manually modified pedido: 7985_519
2026-04-27 17:30:07,139 [INFO] Skipped manually modified pedido: 7749_125
2026-04-27 17:30:07,140 [INFO] Skipped manually modified pedido: 7864_297
2026-04-27 17:30:07,149 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,153 [INFO] Skipped manually modified pedido: 7980_506
2026-04-27 17:30:07,157 [INFO] Skipped manually modified pedido: 7896_358
2026-04-27 17:30:07,159 [INFO] Skipped manually modified pedido: 8081_707
2026-04-27 17:30:07,159 [INFO] Skipped manually modified pedido: 7980_507
2026-04-27 17:30:07,166 [INFO] Skipped manually modified pedido: 7749_125
2026-04-27 17:30:07,184 [INFO] Skipped manually modified pedido: 7763_151
2026-04-27 17:30:07,196 [INFO] Skipped manually modified pedido: 7980_509
2026-04-27 17:30:07,197 [INFO] Skipped manually modified pedido: 7801_208
2026-04-27 17:30:07,201 [INFO] Skipped manually modified pedido: 7808_217
2026-04-27 17:30:07,202 [INFO] Skipped manually modified pedido: 8051_641
2026-04-27 17:30:07,216 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,226 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,226 [INFO] Skipped manually modified pedido: 7980_509
2026-04-27 17:30:07,234 [INFO] Skipped manually modified pedido: 7763_151
2026-04-27 17:30:07,234 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,237 [INFO] Skipped manually modified pedido: 7896_358
2026-04-27 17:30:07,240 [INFO] Skipped manually modified pedido: 7749_125
2026-04-27 17:30:07,245 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:07,262 [INFO] Skipped manually modified pedido: 8051_641
2026-04-27 17:30:07,262 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:07,263 [INFO] Skipped manually modified pedido: 7871_314
2026-04-27 17:30:07,268 [INFO] Skipped manually modified pedido: 7801_208
2026-04-27 17:30:07,291 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,292 [INFO] Skipped manually modified pedido: 7985_519
2026-04-27 17:30:07,301 [INFO] Skipped manually modified pedido: 7808_217
2026-04-27 17:30:07,313 [INFO] Skipped manually modified pedido: 8079_705
2026-04-27 17:30:07,316 [INFO] Skipped manually modified pedido: 7871_314
2026-04-27 17:30:07,322 [INFO] Skipped manually modified pedido: 7801_206
2026-04-27 17:30:07,323 [INFO] Skipped manually modified pedido: 7980_509
2026-04-27 17:30:07,326 [INFO] Skipped manually modified pedido: 7979_505
2026-04-27 17:30:07,330 [INFO] Skipped manually modified pedido: 7864_297
2026-04-27 17:30:07,334 [INFO] Skipped manually modified pedido: 7896_358
2026-04-27 17:30:07,339 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,341 [INFO] Skipped manually modified pedido: 7898_363
2026-04-27 17:30:07,345 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:07,354 [INFO] Skipped manually modified pedido: 7703_39
2026-04-27 17:30:07,356 [INFO] Skipped manually modified pedido: 7823_245
2026-04-27 17:30:07,362 [INFO] Skipped manually modified pedido: 7823_243
2026-04-27 17:30:07,364 [INFO] Skipped manually modified pedido: 7838_266
2026-04-27 17:30:07,365 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,376 [INFO] Skipped manually modified pedido: 7985_519
2026-04-27 17:30:07,381 [INFO] Skipped manually modified pedido: 7823_246
2026-04-27 17:30:07,389 [INFO] Skipped manually modified pedido: 7808_217
2026-04-27 17:30:07,393 [INFO] Merge de pedidos completado: 1 insertados, 371 actualizados, 110 omitidos
2026-04-27 17:30:07,393 [INFO] Carga completada en 0.64s
2026-04-27 17:30:07,393 [INFO] [SUCCESS] ETL completado sin errores
2026-04-27 17:30:07,393 [INFO] === PROCESO ETL COMPLETADO EXITOSAMENTE ===
2026-04-27 17:30:07,393 [INFO] Resumen: órdenes 1, pedidos 1
Tip: Usa Ctrl+F para buscar texto específico en el log