Ver Log ETL

etl_20260424_163002.log

Volver a Logs Dashboard
Archivo:
etl_20260424_163002.log
Modificado:
24/04/2026 16:30:07
Tamaño:
13.3 KB
Líneas:
150 líneas
2026-04-24 16:30:02,302 [INFO] Iniciando proceso ETL... 2026-04-24 16:30:02,303 [INFO] === INICIO ETL === 2026-04-24 16:30:02,303 [INFO] Paso 0: Sincronización de IDs 2026-04-24 16:30:02,303 [INFO] Sincronizando tabla pedidos_id_mapping... 2026-04-24 16:30:02,303 [INFO] Intentando conectar a SQL Server... 2026-04-24 16:30:03,274 [INFO] Conexión SQL Server exitosa 2026-04-24 16:30:03,678 [INFO] Sincronización completada: 1 nuevos IDs asignados 2026-04-24 16:30:03,678 [INFO] Paso 1: Extracción de datos 2026-04-24 16:30:03,678 [INFO] Iniciando extracción de cabeceras 2026-04-24 16:30:03,678 [INFO] Extrayendo órdenes desde linux_ordenes... 2026-04-24 16:30:03,678 [INFO] Intentando conectar a SQL Server... 2026-04-24 16:30:04,263 [INFO] Conexión SQL Server exitosa 2026-04-24 16:30:04,263 [INFO] Ejecutando consulta (últimos 30 días desde 2026-03-25): SELECT numero, cliente, vendedor, fecha_entrega, dias_restantes, estatus FROM dbo.linux_ordenes WHERE fecha_entrega >= ? 2026-04-24 16:30:04,885 [INFO] Extraídas 173 órdenes 2026-04-24 16:30:04,885 [INFO] [DEBUG] Columnas ordenes: ['numero', 'cliente', 'vendedor', 'fecha_entrega', 'dias_restantes', 'estatus'] 2026-04-24 16:30:04,885 [INFO] [DEBUG] dtypes ordenes: {'numero': dtype('O'), 'cliente': dtype('O'), 'vendedor': dtype('O'), 'fecha_entrega': dtype('O'), 'dias_restantes': dtype('int64'), 'estatus': dtype('O')} 2026-04-24 16:30:04,893 [INFO] [DEBUG] Nulos en fecha_entrega (ordenes) tras limpiar: 0 2026-04-24 16:30:04,989 [INFO] Iniciando extracción de líneas 2026-04-24 16:30:04,990 [INFO] Extrayendo pedidos desde linux_pedidos... 2026-04-24 16:30:04,990 [INFO] Intentando conectar a SQL Server... 2026-04-24 16:30:05,570 [INFO] Conexión SQL Server exitosa 2026-04-24 16:30:05,570 [INFO] Ejecutando consulta (últimos 30 días desde 2026-03-25): SELECT id, orden_id, clave, producto, unidad, cantidad, surtido, liq, saldo, fecha_entrega, remision FROM dbo.linux_pedidos WHERE fecha_entrega >= ? 2026-04-24 16:30:06,400 [INFO] Extraídos 488 pedidos 2026-04-24 16:30:06,400 [INFO] [DEBUG] Columnas pedidos: ['id', 'orden_id', 'clave', 'producto', 'unidad', 'cantidad', 'surtido', 'liq', 'saldo', 'fecha_entrega', 'remision'] 2026-04-24 16:30:06,401 [INFO] [DEBUG] dtypes pedidos: {'id': dtype('O'), 'orden_id': dtype('float64'), 'clave': dtype('O'), 'producto': dtype('O'), 'unidad': dtype('O'), 'cantidad': dtype('int64'), 'surtido': dtype('int64'), 'liq': dtype('int64'), 'saldo': dtype('int64'), 'fecha_entrega': dtype('O'), 'remision': dtype('float64')} 2026-04-24 16:30:06,407 [INFO] [DEBUG] Nulos en fecha_entrega (pedidos) tras limpiar: 0 2026-04-24 16:30:06,503 [INFO] Extraídas 488 líneas 2026-04-24 16:30:06,503 [INFO] Extracción completada en 2.82s 2026-04-24 16:30:06,503 [INFO] Paso 2: Transformación de datos 2026-04-24 16:30:06,503 [INFO] Transformando datos de cabeceras 2026-04-24 16:30:06,504 [INFO] [DEBUG] Nulos por columna (cabeceras): {'numero': 0, 'cliente': 0, 'vendedor': 0, 'fecha_entrega': 0, 'dias_restantes': 0, 'estatus': 0} 2026-04-24 16:30:06,511 [INFO] Transformadas 173 cabeceras 2026-04-24 16:30:06,512 [INFO] [DEBUG] Ejemplo cabeceras transformadas (3): [{'id': '7696', 'numero': '7696', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 101, 'prioridad': 'PROGRAMADO'}, {'id': '7702', 'numero': '7702', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 101, 'prioridad': 'PROGRAMADO'}, {'id': '7703', 'numero': '7703', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 101, 'prioridad': 'PROGRAMADO'}] 2026-04-24 16:30:06,512 [INFO] Transformando datos de líneas 2026-04-24 16:30:06,513 [INFO] [DEBUG] Nulos por columna (lineas): {'id': 0, 'orden_id': 0, 'clave': 0, 'producto': 0, 'unidad': 0, 'cantidad': 0, 'surtido': 0, 'liq': 0, 'saldo': 0, 'fecha_entrega': 0, 'remision': 122} 2026-04-24 16:30:06,531 [INFO] Transformadas 488 líneas 2026-04-24 16:30:06,532 [INFO] [DEBUG] Ejemplo líneas transformadas (3): [{'id': '7746_122', 'ID_UNICO': '7746_122', 'orden_id': '7746.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 12500, 'surtido': 12500, 'liq': 12500, 'saldo': 0, 'fecha_entrega': '2026-08-03', 'remision': '5570.0', 'dias_restantes': 101, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7952_467', 'ID_UNICO': '7952_467', 'orden_id': '7952.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 87500, 'surtido': 36000, 'liq': 87500, 'saldo': 51500, 'fecha_entrega': '2026-08-03', 'remision': '5776.0', 'dias_restantes': 101, 'entregado': 0, 'estatus': 'pendiente', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7980_506', 'ID_UNICO': '7980_506', 'orden_id': '7980.0', 'clave': '8000004', 'producto': 'MASILLA SELLADORA 1003.1H', 'unidad': 'KG', 'cantidad': 357, 'surtido': 357, 'liq': 357, 'saldo': 0, 'fecha_entrega': '2026-04-27', 'remision': '5791.0', 'dias_restantes': 3, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}] 2026-04-24 16:30:06,532 [INFO] Transformación completada en 0.03s 2026-04-24 16:30:06,532 [INFO] Paso 3: Carga de datos 2026-04-24 16:30:06,621 [INFO] Skipped manually modified orden: 7718 2026-04-24 16:30:06,621 [INFO] Skipped manually modified orden: 7719 2026-04-24 16:30:06,621 [INFO] Skipped manually modified orden: 7720 2026-04-24 16:30:06,623 [INFO] Skipped manually modified orden: 7729 2026-04-24 16:30:06,626 [INFO] Skipped manually modified orden: 7751 2026-04-24 16:30:06,628 [INFO] Skipped manually modified orden: 7792 2026-04-24 16:30:06,632 [INFO] Skipped manually modified orden: 7833 2026-04-24 16:30:06,633 [INFO] Skipped manually modified orden: 7835 2026-04-24 16:30:06,637 [INFO] Skipped manually modified orden: 7881 2026-04-24 16:30:06,663 [INFO] Skipped manually modified orden: 8014 2026-04-24 16:30:06,679 [INFO] Skipped manually modified orden: 8050 2026-04-24 16:30:06,693 [INFO] Merge de órdenes completado: 1 insertadas, 161 actualizadas, 11 omitidas 2026-04-24 16:30:06,713 [INFO] Skipped manually modified pedido: 7980_506 2026-04-24 16:30:06,723 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:06,725 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,730 [INFO] Skipped manually modified pedido: 7899_365 2026-04-24 16:30:06,737 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:06,740 [INFO] Skipped manually modified pedido: 7871_314 2026-04-24 16:30:06,741 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,744 [INFO] Skipped manually modified pedido: 7899_365 2026-04-24 16:30:06,750 [INFO] Skipped manually modified pedido: 7871_314 2026-04-24 16:30:06,751 [INFO] Skipped manually modified pedido: 7898_363 2026-04-24 16:30:06,755 [INFO] Skipped manually modified pedido: 7807_215 2026-04-24 16:30:06,756 [INFO] Skipped manually modified pedido: 7871_314 2026-04-24 16:30:06,766 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,766 [INFO] Skipped manually modified pedido: 7838_266 2026-04-24 16:30:06,767 [INFO] Skipped manually modified pedido: 7896_358 2026-04-24 16:30:06,774 [INFO] Skipped manually modified pedido: 7808_217 2026-04-24 16:30:06,777 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:06,782 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:06,784 [INFO] Skipped manually modified pedido: 7838_267 2026-04-24 16:30:06,788 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:06,793 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,794 [INFO] Skipped manually modified pedido: 7808_217 2026-04-24 16:30:06,795 [INFO] Skipped manually modified pedido: 7980_507 2026-04-24 16:30:06,808 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:06,814 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:06,818 [INFO] Skipped manually modified pedido: 7808_217 2026-04-24 16:30:06,823 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:06,828 [INFO] Skipped manually modified pedido: 7807_215 2026-04-24 16:30:06,830 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:06,834 [INFO] Skipped manually modified pedido: 8051_639 2026-04-24 16:30:06,835 [INFO] Skipped manually modified pedido: 7801_208 2026-04-24 16:30:06,841 [INFO] Skipped manually modified pedido: 7838_266 2026-04-24 16:30:06,849 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,849 [INFO] Skipped manually modified pedido: 7980_506 2026-04-24 16:30:06,867 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:06,878 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,878 [INFO] Skipped manually modified pedido: 7899_365 2026-04-24 16:30:06,881 [INFO] Skipped manually modified pedido: 7807_215 2026-04-24 16:30:06,890 [INFO] Skipped manually modified pedido: 7980_507 2026-04-24 16:30:06,894 [INFO] Skipped manually modified pedido: 7838_267 2026-04-24 16:30:06,899 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,905 [INFO] Skipped manually modified pedido: 8051_639 2026-04-24 16:30:06,907 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:06,912 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:06,912 [INFO] Skipped manually modified pedido: 8068_693 2026-04-24 16:30:06,913 [INFO] Skipped manually modified pedido: 7838_267 2026-04-24 16:30:06,916 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,918 [INFO] Skipped manually modified pedido: 7980_506 2026-04-24 16:30:06,925 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,932 [INFO] Skipped manually modified pedido: 7838_267 2026-04-24 16:30:06,960 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:06,962 [INFO] Skipped manually modified pedido: 7881_333 2026-04-24 16:30:06,965 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:06,970 [INFO] Skipped manually modified pedido: 7985_519 2026-04-24 16:30:06,971 [INFO] Skipped manually modified pedido: 7749_125 2026-04-24 16:30:06,980 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:06,988 [INFO] Skipped manually modified pedido: 7896_358 2026-04-24 16:30:06,989 [INFO] Skipped manually modified pedido: 7980_507 2026-04-24 16:30:06,996 [INFO] Skipped manually modified pedido: 7749_125 2026-04-24 16:30:07,012 [INFO] Skipped manually modified pedido: 7763_151 2026-04-24 16:30:07,026 [INFO] Skipped manually modified pedido: 7801_208 2026-04-24 16:30:07,030 [INFO] Skipped manually modified pedido: 7808_217 2026-04-24 16:30:07,032 [INFO] Skipped manually modified pedido: 8051_641 2026-04-24 16:30:07,048 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:07,055 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:07,063 [INFO] Skipped manually modified pedido: 7763_151 2026-04-24 16:30:07,063 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:07,066 [INFO] Skipped manually modified pedido: 7896_358 2026-04-24 16:30:07,070 [INFO] Skipped manually modified pedido: 7749_125 2026-04-24 16:30:07,074 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:07,094 [INFO] Skipped manually modified pedido: 8051_641 2026-04-24 16:30:07,095 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:07,096 [INFO] Skipped manually modified pedido: 7871_314 2026-04-24 16:30:07,100 [INFO] Skipped manually modified pedido: 7801_208 2026-04-24 16:30:07,128 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:07,129 [INFO] Skipped manually modified pedido: 7985_519 2026-04-24 16:30:07,132 [INFO] Skipped manually modified pedido: 7881_333 2026-04-24 16:30:07,138 [INFO] Skipped manually modified pedido: 7808_217 2026-04-24 16:30:07,157 [INFO] Skipped manually modified pedido: 7871_314 2026-04-24 16:30:07,169 [INFO] Skipped manually modified pedido: 7979_505 2026-04-24 16:30:07,179 [INFO] Skipped manually modified pedido: 7896_358 2026-04-24 16:30:07,187 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:07,189 [INFO] Skipped manually modified pedido: 7731_100 2026-04-24 16:30:07,190 [INFO] Skipped manually modified pedido: 7898_363 2026-04-24 16:30:07,194 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:07,198 [INFO] Skipped manually modified pedido: 7731_100 2026-04-24 16:30:07,211 [INFO] Skipped manually modified pedido: 7823_245 2026-04-24 16:30:07,220 [INFO] Skipped manually modified pedido: 7823_243 2026-04-24 16:30:07,224 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:07,237 [INFO] Skipped manually modified pedido: 7985_519 2026-04-24 16:30:07,246 [INFO] Skipped manually modified pedido: 7823_246 2026-04-24 16:30:07,256 [INFO] Skipped manually modified pedido: 7808_217 2026-04-24 16:30:07,260 [INFO] Skipped manually modified pedido: 7731_100 2026-04-24 16:30:07,265 [INFO] Merge de pedidos completado: 1 insertados, 394 actualizados, 93 omitidos 2026-04-24 16:30:07,266 [INFO] Carga completada en 0.73s 2026-04-24 16:30:07,267 [INFO] [SUCCESS] ETL completado sin errores 2026-04-24 16:30:07,267 [INFO] === PROCESO ETL COMPLETADO EXITOSAMENTE === 2026-04-24 16:30:07,267 [INFO] Resumen: órdenes 1, pedidos 1
Tip: Usa Ctrl+F para buscar texto específico en el log