主页 / unix / 问题

问题[json](unix)

Martin Hope
tinlyx
Asked: 2024-10-07 16:13:03 +0800 CST
  • 8

我有时需要编写包含字符串值的 JSON 字符串，该字符串本身就是一个 JSON 字符串。例如在以下 JSON 对象中：

echo '{"rec" : " {\"id\": 1, \"name\": \"x\"}" }' | jq .

{
  "rec": " {\"id\": 1, \"name\": \"x\"}"
}

处的值"rec"是字符串形式的json {\"id\": 1, \"name\": \"x\"}"。

编写这种转义的 json 字符串非常繁琐，因为需要将每个双引号转义"为\"。

我的问题是：

给定内容{ "id": 1, "name": "x"}，是否有一种使用 bash/jq 的自动方法可以正确地转义引号并获取可用作 JSON 字符串值的引号形式 "{\"id\": 1, \"name\": \"x\"}"？

json
Martin Hope
Anil Samuel
Asked: 2024-08-30 12:51:21 +0800 CST
  • 4

如何使用 jq 循环更新 json 文件（如下所示）？json 文件需要在 curl 响应主体中使用 json 更新 .queryToken 并附加 .result 数组

while true
do
  curl -k --location 'https://api.../queryMore' \
          --user "uname:pswd" \
          --data "$(jq '.queryToken' Process.json)" |
   jq '{
         numberOfResults: .numberOfResults,
         queryToken: .queryToken,
         result: .result
       }'
 #update .queryToken in Process.json and append .result to .result in Process.json
 #break if no .queryToken
done

文件和 curl 响应的结构相同，如下例所示

{
    "@type": "QueryResult",
    "queryToken": "<base64text>",
    "result": [
      ...
    ]
}
json
Martin Hope
Anil Samuel
Asked: 2024-08-22 17:19:48 +0800 CST
  • 8
[
  {
    "key": "@timestamp",
    "value": "2024-08-21 03:02:57.871"
  },
  {
    "key": "@message",
    "value": "Aug 21, 2024 1:00:11 PM AEST INFO    [com.boomi.util.LogUtil doLog] Node is using valid java"
  },
  {
    "key": "@timestamp",
    "value": "2024-08-21 03:02:42.332"
  },
  {
    "key": "@message",
    "value": "Aug 21 13:02:37 ip-10-250-122-60 auditd[3013]: Audit daemon rotating log files"
  }
]

如何使用 jq 将 JSON 转换为下面的 JSON

[
  {
    "@timestamp": "2024-08-21 03:02:57.871",
    "@message": "Aug 21, 2024 1:00:11 PM AEST INFO    [com.boomi.util.LogUtil doLog] Node is using valid java"
  },
  {
    "@timestamp": "2024-08-21 03:02:42.332",
    "@message": "Aug 21 13:02:37 ip-10-250-122-60 auditd[3013]: Audit daemon rotating log files"
  }
]
json
Martin Hope
tinlyx
Asked: 2024-05-16 16:55:34 +0800 CST
  • 11

我想使用 jqb从两个可能的路径（并且仅这两个路径）获取特定值。所以，基本上，我想说

jq '(path1 OR path2) | .b'

b如果位于两条路径之一path1或 ，则应该有效path2。如果两条路径都有b，则第一条路径优先。

例如，两者

echo '{"b":2}' | jq '.b'
echo '{"a": {"b":2}}' | jq '.a.b'

提取b于.和.a。

我可以说

echo ... | jq '(MAGIC).b'

使其适用于上面的两个输入？

到目前为止我尝试的是使用递归运算符..：

jq '[..|.b?|values]|first'

这种方法的作用在于：

echo '{"b":2}' | jq '[..|.b?|values]|first'
echo '{"a": {"b":2}}' | jq '..|.b?|values|first'

给2。但它不够具体，并且还允许b位于下面树中的任何位置.。它也很难阅读。另外，如果两条路径没有父子关系，则可能无法工作。

（这是 Ubuntu 24.04 LTS 中的 jq 1.7）

json
Martin Hope
Seer
Asked: 2024-04-23 14:56:18 +0800 CST
  • 9

需要明确的是 - 我想要一个伪 JSON 输出，该输出将被写入此处的另一个静态 JSON 文件中...因此不包含在数组或任何内容中，只需在输出中的每个实体后面获取丢失的逗号即可。

目前我的查询是：

.[] | select(.auditId == "categories") |
{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "*\(.auditProperty):* \(.actual) (expected \(.expected))"
  }
}

哪个输出：

{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "*performance:* 1 (expected 0.8)"
  }
}
{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "*accessibility:* 1 (expected 0.9)"
  }
}
{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "*best-practices:* 0.96 (expected 0.9)"
  }
}
{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "*seo:* 0.64 (expected 0.5)"
  }
}

当我真正想要的时候：

{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "*performance:* 1 (expected 0.8)"
  }
},
{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "*accessibility:* 1 (expected 0.9)"
  }
},
{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "*best-practices:* 0.96 (expected 0.9)"
  }
},
{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "*seo:* 0.64 (expected 0.5)"
  }
},

请注意每个实体后面的逗号！这让我发疯，我尝试join(", ")在不同的地方添加 a ，但这要么对最终输出没有任何作用，要么无法编译，具体取决于我放置它的位置。

这是包含数据的 jqplay https://jqplay.org/s/xx3F_IWn03g

原始输入 JSON：

[
  {
    "name": "minScore",
    "expected": 0.8,
    "actual": 1,
    "values": [
      1,
      1,
      1
    ],
    "operator": ">=",
    "passed": true,
    "auditProperty": "performance",
    "auditId": "categories",
    "level": "error",
    "url": "http://localhost:8080/page2"
  },
  {
    "name": "minScore",
    "expected": 0.9,
    "actual": 1,
    "values": [
      1,
      1,
      1
    ],
    "operator": ">=",
    "passed": true,
    "auditProperty": "accessibility",
    "auditId": "categories",
    "level": "error",
    "url": "http://localhost:8080/page2"
  },
  {
    "name": "minScore",
    "expected": 0.9,
    "actual": 0.96,
    "values": [
      0.93,
      0.96,
      0.96
    ],
    "operator": ">=",
    "passed": true,
    "auditProperty": "best-practices",
    "auditId": "categories",
    "level": "error",
    "url": "http://localhost:8080/page2"
  },
  {
    "name": "minScore",
    "expected": 0.5,
    "actual": 0.64,
    "values": [
      0.64,
      0.64,
      0.64
    ],
    "operator": ">=",
    "passed": true,
    "auditProperty": "seo",
    "auditId": "categories",
    "level": "error",
    "url": "http://localhost:8080/page2"
  }
]
json
Martin Hope
verideskstar
Asked: 2024-02-07 02:41:55 +0800 CST
  • 6

我有来自 Junos REST API 的以下 JSON 文档。我正在尝试将文档简化为仅选定的几个项目。我将如何实现这个目标？

预期的 JSON：

[
  {  "status": .member-status[0].data,
     "serial": .member-serial-number[0].data,
     "slot": .fpc-slot[0].data
  },
  ...
]

原始 JSON：

{
  "member-status": [
    {
      "data": "Prsnt"
    }
  ],
  "member-id": [
    {
      "data": "0"
    }
  ],
  "fpc-slot": [
    {
      "data": "(FPC 0)"
    }
  ],
  "member-serial-number": [
    {
      "data": "serNo1"
    }
  ],
  "member-model": [
    {
      "data": "ex4400-24t"
    }
  ],
  "member-priority": [
    {
      "data": "255"
    }
  ],
  "member-mixed-mode": [
    {
      "data": "N"
    }
  ],
  "member-route-mode": [
    {
      "data": "VC"
    }
  ],
  "member-role": [
    {
      "data": "Master*"
    }
  ],
  "neighbor-list": [
    {}
  ]
}
{
  "member-status": [
    {
      "data": "NotPrsnt"
    }
  ],
  "member-id": [
    {
      "data": "1"
    }
  ],
  "fpc-slot": [
    {
      "data": "(FPC 1)"
    }
  ],
  "member-serial-number": [
    {
      "data": "serNo2"
    }
  ],
  "member-model": [
    {}
  ]
}
json
Martin Hope
aneeshdevcube
Asked: 2023-12-07 14:42:45 +0800 CST
  • 7

我有以下名为的 JSON 文件pool.json：

{
   "AllocateActions": {},
   "Available": true,
   "Description": "Pool for nodes in cluster - {{CLUSTER_NAME}}",
   "Endpoint": "",
   "EnterActions": {
     "AddProfiles": [
       "{{RC_JOIN_PROFILE}}",
       "image-deploy-profile",
       "rc-controlplane-profile",
       "rc-etcd-profile"
     ],
     "Workflow": "rc-image-deploy"
   },
   "Errors": [],
   "ExitActions": {
     "RemoveProfiles": [
       "{{RC_JOIN_PROFILE}}",
       "image-deploy-profile"
     ],
     "Workflow": "discover-base"
   },
   "Meta": {
     "color": "black",
     "feature-flags": "sane-exit-codes",
     "icon": "object ungroup outline",
     "title": "User added"
   },
   "ReadOnly": true,
   "ReleaseActions": {},
   "Validated": true
 }

在我的 bash 脚本中，我用来jq将值传递给这些 JSON 占位符：

NODE_JSON=$(jq --arg RC_JOIN_PROFILE "$RC_JOIN_PROFILE" --arg CLUSTER_NAME "$CLUSTER_NAME" '.Description = "'$CLUSTER_NAME'"| .ExitActions.RemoveProfiles = [ "'$RC_JOIN_PROFILE'" ] | .EnterActions.AddProfiles = [ "'$RC_JOIN_PROFILE'" ]' pool.json)

如果我传递RC_JOIN_PROFILE="test-profile"和CLUSTER_NAME="test-cluster"，那么我期望最终的 JSON 如下：

{
   "AllocateActions": {},
   "Available": true,
   "Description": "Pool for nodes in cluster - test-cluster",
   "Endpoint": "",
   "EnterActions": {
     "AddProfiles": [
       "test-profile",
       "image-deploy-profile",
       "rc-controlplane-profile",
       "rc-etcd-profile"
     ],
     "Workflow": "rc-image-deploy"
   },
   "Errors": [],
   "ExitActions": {
     "RemoveProfiles": [
       "test-profile",
       "image-deploy-profile"
     ],
     "Workflow": "discover-base"
   },
   "Meta": {
     "color": "black",
     "feature-flags": "sane-exit-codes",
     "icon": "object ungroup outline",
     "title": "User added"
   },
   "ReadOnly": true,
   "ReleaseActions": {},
   "Validated": true
 }

但是，我在下面得到了 JSON：

{
   "AllocateActions": {},
   "Available": true,
   "Description": "test-cluster",
   "Endpoint": "",
   "EnterActions": {
     "AddProfiles": [
       "test-profile",
     ],
     "Workflow": "rc-image-deploy"
   },
   "Errors": [],
   "ExitActions": {
     "RemoveProfiles": [
       "test-profile",
     ],
     "Workflow": "discover-base"
   },
   "Meta": {
     "color": "black",
     "feature-flags": "sane-exit-codes",
     "icon": "object ungroup outline",
     "title": "User added"
   },
   "ReadOnly": true,
   "ReleaseActions": {},
   "Validated": true
 }

.ExitActions.AddPofiles、.ExitActions.RemoveProfiles和的现有值.Description已被传递的值覆盖。我想要带有传递值的现有值。我尝试了很多场景，但没有任何效果。谁能帮我这个？

json
Martin Hope
code userit
Asked: 2023-09-29 22:53:51 +0800 CST
  • 6

下面是我的json代码

[
{
    "kind": "user",
    "version": "v2",
    "metadata": {
      "name": "person1"
    },
    "spec": {
      "roles": [
        "access",
        "auditor",
        "editor",
        "abc-access"
      ],
      "status": {
        "is_locked": false,
        "locked_time": "0001-01-01T00:00:00Z",
        "lock_expires": "0001-01-01T00:00:00Z",
        "recovery_attempt_lock_expires": "0001-01-01T00:00:00Z"
      },
      "expires": "0001-01-01T00:00:00Z",
      "created_by": {
        "time": "2023-06-07T08:50:58.559675944Z",
        "user": {
          "name": "person2"
        }
      }
    }
  },
  {
    "kind": "user",
    "version": "v2",
    "metadata": {
      "name": "person2"
    },
    "spec": {
      "roles": [
        "access",
        "auditor",
        "editor",
        "abc-access"
      ],
      "status": {
        "is_locked": false,
        "locked_time": "0001-01-01T00:00:00Z",
        "lock_expires": "0001-01-01T00:00:00Z",
        "recovery_attempt_lock_expires": "0001-01-01T00:00:00Z"
      },
      "expires": "0001-01-01T00:00:00Z",
      "created_by": {
        "time": "2023-06-06T14:01:15.256905162Z",
        "user": {
          "name": "person5"
        }
      }
    }
  },
  {
    "kind": "user",
    "version": "v2",
    "metadata": {
      "name": "person3"
    },
    "spec": {
      "roles": [
        "access",
        "auditor",
        "editor",
        "abc-access"
      ],
      "status": {
        "is_locked": false,
        "locked_time": "0001-01-01T00:00:00Z",
        "lock_expires": "0001-01-01T00:00:00Z",
        "recovery_attempt_lock_expires": "0001-01-01T00:00:00Z"
      },
      "expires": "0001-01-01T00:00:00Z",
      "created_by": {
        "time": "2023-06-15T12:16:09.35013254Z",
        "user": {
          "name": "person2"
        }
      }
    }
  },
  {
    "kind": "user",
    "version": "v2",
    "metadata": {
      "name": "person3"
    },
    "spec": {
      "roles": [
        "access",
        "auditor",
        "editor",
        "abc-access"
      ],
      "status": {
        "is_locked": false,
        "locked_time": "0001-01-01T00:00:00Z",
        "lock_expires": "0001-01-01T00:00:00Z",
        "recovery_attempt_lock_expires": "0001-01-01T00:00:00Z"
      },
      "expires": "0001-01-01T00:00:00Z",
      "created_by": {
        "time": "2023-06-06T13:45:30.543520308Z",
        "user": {
          "name": "person6"
        }
      }
    }
  },
  {
    "kind": "user",
    "version": "v2",
    "metadata": {
      "name": "person4"
    },
    "spec": {
      "roles": [
        "access",
        "auditor",
        "editor",
        "abc-access"
      ],
      "status": {
        "is_locked": false,
        "locked_time": "0001-01-01T00:00:00Z",
        "lock_expires": "0001-01-01T00:00:00Z",
        "recovery_attempt_lock_expires": "0001-01-01T00:00:00Z"
      },
      "expires": "0001-01-01T00:00:00Z",
      "created_by": {
        "time": "2023-06-07T04:49:41.39245724Z",
        "user": {
          "name": "person5"
        }
      }
    }
  },
  {
    "kind": "user",
    "version": "v2",
    "metadata": {
      "name": "person5"
    },
    "spec": {
      "roles": [
        "access",
        "auditor",
        "editor",
        "abc-access"
      ],
      "traits": {
        "aws_role_arns": null,
        "db_names": null,
        "db_users": null,
        "kubernetes_groups": null,
        "kubernetes_users": null,
        "logins": [
          "ec2-user",
          "root"
        ],
        "windows_logins": null
      },
      "status": {
        "is_locked": false,
        "locked_time": "0001-01-01T00:00:00Z",
        "lock_expires": "0001-01-01T00:00:00Z",
        "recovery_attempt_lock_expires": "0001-01-01T00:00:00Z"
      },
      "expires": "0001-01-01T00:00:00Z",
      "created_by": {
        "time": "2023-06-06T13:51:39.173360152Z",
        "user": {
          "name": "person6"
        }
      }
    }
  },
  {
    "kind": "user",
    "version": "v2",
    "metadata": {
      "name": "person6"
    },
    "spec": {
      "roles": [
        "access",
        "editor",
        "auditor"
      ],
      "traits": {
        "aws_role_arns": null,
        "azure_identities": null,
        "db_names": null,
        "db_roles": null,
        "db_users": null,
        "gcp_service_accounts": null,
        "kubernetes_groups": null,
        "kubernetes_users": null,
        "logins": [
          "root",
          "ubuntu",
          "ec2-user"
        ],
        "windows_logins": null
      },
      "status": {
        "is_locked": false,
        "locked_time": "0001-01-01T00:00:00Z",
        "lock_expires": "0001-01-01T00:00:00Z",
        "recovery_attempt_lock_expires": "0001-01-01T00:00:00Z"
      },
      "expires": "0001-01-01T00:00:00Z",
      "created_by": {
        "time": "2023-06-06T13:41:41.579010534Z",
        "user": {
          "name": "xyz"
        }
      }
    }
  }
]

我将其转换为 csv

jq -r '.[] | [ .metadata.name ] ,  [ .spec.roles[] ] | @csv' ind.json

上述命令的输出如下

"person1"
"alpha","gamma","beta","abc-access"
"person2"
"alpha","gamma","beta","abc-access"
"person3"
"alpha","gamma","beta","abc-access"
"person3"
"alpha","gamma","beta","abc-access"
"person4"
"alpha","gamma","beta","abc-access"
"person5"
"alpha","gamma","beta","abc-access"
"person6"
"alpha","gamma","beta","auditor"

我想要不同列中的名称和角色。我希望名称和角色在同一行并具有足够的空间，这样如果我们在 Excel 中复制粘贴，它将是两列，一列包含“名称”，另一列包含“角色”。如果我们得到不带双引号的输出，还要寻找选项

以下是预期输出

person1    alpha,gamma,beta,abc-access
person2    alpha,gamma,beta,abc-access
person3    alpha,gamma,beta,abc-access
person3    alpha,gamma,beta,abc-access
person4    alpha,gamma,beta,abc-access
person5    alpha,gamma,beta,abc-access
person6    alpha,gamma,beta,auditor
json
Martin Hope
Marcos
Asked: 2023-07-31 10:35:35 +0800 CST
  • 5

在接下来的MWE中

echo x="1e2" | mlr --ojson cat

我的目的是让 miller 生成一个包含该对象的单元素 JSON 数组

{"x": "1e2"}

实际返回的对象（在数组内）是

{"x": 1e2}

其中值被视为数字，我猜这是其解析的结果。我如何告诉 miller 生成 JSON 对象，其值是字符串而不是数字？（MWE 中“1e2”周围引号的基本原理正是为了强调这一意图。）

json
Martin Hope
Velin Budinov
Asked: 2023-07-07 16:32:55 +0800 CST
  • 12

我需要使用 jq 将 JSON 字符串转换为表格格式，以便在终端中显示输出，如下所示。

{
  "results": [
    [
      {
        "field": "@timestamp",
        "value": "2023-07-03 08:28:00.000"
      },
      {
        "field": "CpuReserved",
        "value": "8192.0"
      },
      {
        "field": "CpuUtilized",
        "value": "4056.412942708333"
      },
      {
        "field": "MemoryReserved",
        "value": "61440"
      },
      {
        "field": "MemoryUtilized",
        "value": "4311"
      },
      {
        "field": "@ptr",
        "value": "CpABClUKUTE0NjcxNzAzNzI0NzovYXdzL2Vjcy9jb250YWluZXJpbnNpZ2h0cy9pcmwtaW5mcmEtc2hhcmVkLWplbmtpbnMtbWFpbi9wZXJmb3JtYW5jZRABEjUaGAIGSaxosQAAAAAd+TFeAAZKKHIwAAABEiABKIDF9taRMTDA7v3WkTE4BkC9NEjNPFCBIRgAEAAYAQ=="
      }
    ],
    [
      {
        "field": "@timestamp",
        "value": "2023-07-03 08:28:00.000"
      },
      {
        "field": "CpuReserved",
        "value": "8192.0"
      },
      {
        "field": "CpuUtilized",
        "value": "4056.412942708333"
      },
      {
        "field": "MemoryReserved",
        "value": "61440"
      },
      {
        "field": "MemoryUtilized",
        "value": "4311"
      },
      {
        "field": "@ptr",
        "value": "CpABClUKUTE0NjcxNzAzNzI0NzovYXdzL2Vjcy9jb250YWluZXJpbnNpZ2h0cy9pcmwtaW5mcmEtc2hhcmVkLWplbmtpbnMtbWFpbi9wZXJmb3JtYW5jZRABEjUaGAIGSaxosQAAAAAd+TFeAAZKKHIwAAABEiABKIDF9taRMTDA7v3WkTE4BkC9NEjNPFCBIRgAEAEYAQ=="
      }
    ]
  ]
}

我想在终端中显示的内容如下：

@timestamp                CpuReserved  CpuUtilized         MemoryReserved   MemoryUtilized  
==========================================================================================
2023-07-03 08:16:00.000   8192.0       410.5300065104166   61440            1417
2023-07-03 08:15:00.000   8192.0       702.310791015625    61440            792

有人可以引导我走向正确的方向吗？

json